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ABSTRACT 

Two abstracts and seventeen articles on computer 
assisted instruction (CAI) presented at the 1976 Association for 
Educational Data Systems ' (AEDS) convention are included here. Four 
new computer programs are described: Author System for Education and 
Training (ASET) ; GNOSIS,' a Swedish/English CAI package; Statistical 
Interactive Programming System (SIPS); and Instructional Dialogue 
Facility (IDF) which helps classroom teachers learn CAI languages. 
Six* papers examine interactive computer systems and interactive CAI, 
and one paper describes an interactive educational system which uses 
video discs in con junction -with computers. Six papers describe 
various programs: a CAI course in lo£ic instruction for department of 
defense persoipiel, CAI for computer science education, computets for 
drill and practice in math, and general use of CAI in elementary 
school classrooms. A computer program which monitors student progress 
in calculus is described, and user groups are the topic of one 
article. (CH) 
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The Physics Computer Development Project at 
the University of California, Irvine, is involved 
in the development and use of computer-based 
teaching materials, primarily in the sciences*. 
Several recent review papers about our activities 
have been published. 1 These papers typically 
consider the Project objectives, the types of 
dialogs available, and the authoring procedures 
for developing dialogs. 

'The present paper gives a different cross sec- 
tion on how Computers are used in education at 
Irvine- by concentrating on a single month's ac- 
tivity^ January, # 1976.u> It considers both dialog 
usage and dialog developmental work during that 
period. Naturally any one month will have pecu- 
liarities associated with it, but this mode of 
presentation may be of some, interest ij^ viewing 
an ongoing project that is developing computer- 
base^ dialogs. Many other class uses, such as 
those involving student programming, are not conA 
sidered. * 

I rvlne . Computer Facilities 

The University of California, Irvine, is one 
of the three new campuses of .the nine-campus 
University of Califo/nia system, -established 
about ten years ago. Ralph Gerard, our first 
dean of graduate studies, and Daniel G. Aldrich, 
Jr., our Chancellor, became convinced at that 
time that computers were to play an increasingly 
important role in the. learning process. Hence, 
Irvine acquired more facilities for using com- 
puters with students, than is typical on univer- 
sity campuses. After some rough beginnings we 
finally arrived at a stable configuration of com- 
puters about seven years ago. 

The campus now operates three general purpose 
computers in competition with each other. The 
computers are a Sigma 7 (the one used in all 
activities to be reported in this paper), a 
PCP-10, and a PDP-11/^. All three are available 
for all types of wx>rk, and the two larger sys- 
tems, the Sigma 7 and the PDP-10, support both 
batch and timesharing. The Sigma 7 has about 
seventy physical ports and the PDP-10 has about 
thirty physical ports. Although we have no accur- 
ate figures of the numbers of terminals on £am- 
pus,' it is estimated that perhaps 175 terminals 
are on campus, about 100 generally accessible 
to students. 



The work of the Physics Computer Development 
Project, funded by the National Science Founda- 
tion and the University of California, is almost 
entirely dependent on graphic capabilities, so 
.graphic terminals are employed in most of the 
activities reported in this discussion. We cur- 
rently have about thirty Tektronix 4013 terminals 
available *or student use, about twenty-five on 
the Sigma 7. Although some of the dialog activi- 
ties can take place'on nongraphic terminals, most 
require graphics. 

j january Classes 

Most of the student-computer dialogs developed 
in the Physics Computer Development Project have 
bein intended for beginning science classes. 
Which materials are heavily used in a particular 
month is dependent on which classes are being 
taught, and wjiere those classes are in their 
syllabi. Most of the use described took place in 
tHree classes. One was the Math 1 class, a pre- 
paration for beginning calculus. Students take. 
Math 1 only if they fail an entrance exam in the 
calculus course. A second important class was 
the Physics 3B class, the second quarter of a 
thifee-quarter general physics survey taken pri- 
marily by biology majors, mostly premedical stu- 
dents. The third course, Physics 5A, is the 
firjst quarter of a five-quarter introductory 
course primarily for science and engineering 
majors, also with a good sprinkling of biology 
students. In the Physics 3B course the computer 
plays a major role in the structure of the course. 
In [the Physics 5A course computer activity is sim- 
ply another learning mode among others available 
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usfe if the student desires. 



(It should not be implied that all the use of 
the computer at this time took plaice in just 
th|}S*e classes. Considerable additional access 
copes from students not enrolled in any physics 
classed employing the dialogs.*- This nonclass use 
tends to spread much more throughout the entire 
range of dialogs. (There are perhaps seventy 
dialogs for student use available in all areas 
at Irvine at the present time.) So this "free" 
use of dialogs does not show up in the major dia- 
log usage to be reported here. 
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J anuary Usage * i 

Computer dialogs Iceep in files accurate usage 
figures, so we know just which dialogs are used, 
by whom, and how much. About cwice a month we 
sort this tile; jfnd the. fol lowing data were ob- 
tained from that soured. 

Dialogs were used during January, 1976 for 
approximately 120, OOO^Xerminal minutes. About 
900 individuals, almost all students, were in- 
volved in about 8,000 separate sessions. These 
figures for January are typical of those in re- 
cent months during the current academijj year. 

It should be indicated that there is not com- 
plete^ "free" use at/Irvine, Thk three classes 
mentioned share a group of sixf^en "parts." If 
a student in one of /the classes tYies to sign on 
when all sixteen pcrts are busy, he or she will 
receive * message xo that effect and will not be 
able to Kiin access to the computer. The avail- 
ability ot terminals in the busy times of day , 
might also be another limiting factor; there are 
three ccmcentrat ions of graphic terminals, one 
between the computers themselves, one on the 
first fW'or of the Physical Science'building,.and 
one on the fourth floor of the Physical Science 
building, and these terminals are heavily em- 
ployed. Although Irvifie provides more student 
access to computing than many universities, com- 
puting is stiH a valuable commodity, and we do 
not have a completely free access .mayket . It is 
difficult to predict what usa$y» wbuld be without 
constraints, but it would be considerably larger. 

The following table shows the statistics for 
the most widely used dialogs at- Irvine. 
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dialogs. The reader should remember that this 
does not represent total dialog usage, but only 
the dialogs used most heavily, more than 500 min- 
utes of terminal time during the roonth# The head 
Ing "Students" Is slightly misleading. While 
most of this is 'sttident' use, some developmental 
use v - to, be described below, is also represented; 



aboutj&enty of the "students" were actually de- 
velopers of the dialog material. 

In the next few sections I will review partic- 
ular dialogs^ describing them and telling little 
bit about the class environment in which they were 
used. 

The Math Quizzes 

Ab indicated above, Math If is a "remedial" 
math class taken by students expected to h,ave 
difficulty with the cajculus courses. It was a 
large class, with approxAately 300 students in 
the winter quarter. "The class is taught in the 
PSI or Keller plan strategy, with students moving 
—at their own individual paces through the units. 
All the exams, needed to show success in each 
unit, are .taken directly on-line to the computer. 
The'se exams are picked out of a large pool ol 
questions, so that students get a different exam 
each time they take the quiz. The student at- 
tempts the quiz as many times as is needed to 
demonstrate that the material has been mastered. 

On the charfc the math quizzes 'start with ohe 
letters "QZ." Thus about sev^n different quizzes 
were usea* in January, indicating that the stu- • 
dents were indeed dispersed in different parts of 
the course, typical in a Keller plan course. The 
quizzes have a huilt-in timing, limit; the Student 
is not allowed to spend more than one hour in tak- 
ing a single quiz. You cart see that they average 
about twenty-five minutes per <juiz. Statistics 
also indicate that for most of the quizzes stu- 
dents typically take them about twice before 
"•succeeding. 

The Math 1 quizzes were developed by John 
Grover and Stephen Franklin of the Math Depart- 
ment at UCI. Comparisons of their use versus 
other imilarly versatile ways of teaching the 
course indicate that this mode of teaching is 
cost effective. ^ 

FIELD 

About one-'quarter of the total use of Irvine 
dialogs during the month of January came from a 
single dialog, FIELD. The subject matter of 
FIELD is electrostatics. It carries the student 
from very simple beginning, considering the di- 
rection of the forces between ©tfarged particles* 
into the- sophisticated notions of the electric 
field and fi<£d Iines t . The student plays an ac- , 
tive role'in the learning process. FIELD ends 
wixh a field-plotting facility in which students 
sp^ify arbitrary locations for charges, and then 
ask for either electric field lines or equipoten- 
. tial lines. The dialog ha&> a map at the begin- 
ning, allowing students to Jump into any particu- 
lar section. They can return to this map at 
some later time, and then move to a different 
section of the program. 

The large use of FIELD represents the Physics 
3& course. The second quarter of that course is 
concerned with electricity and magnetism, and ' 
starts with electrostatics. FIELD was recom- 
mended to students as a viable alternate to 
> 
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THREE POSITIVE CHARGES ARE ARRANGED IN AN 

EQUILATERAL TRIANGLE 

A-TUICE TJC CHARGE OF '•' 

THE FORCE ON 'C DUE TO 'A' IS INDICATED 

BY THE VECTOR 

POINT TO THE CORRESPONDING FORCE VECTOR ON C 
DUE TO PARTICLE 'B' 
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POINT AGAIN 

IT DOES LIE ON THE LINE THROUGH] % 
YOUR MAGNITUDE IS URONO POINT *2^INf 
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UE CAN CALCULATE THE FORCE ON OUR 'TE$T' 
PARTICLE NO NATTER UHERE IT IS USE THE POINTER 
AGAIN AND AGAIN TYPE 'S' TO TERMINATE 

PRESS RETURN TO CONTINUE I 



3b8 




VOU SHOULD BE GETTING THE IDEA THAT, UITH 
UHTH OUR TEST CHARGE. UE CAN FIND THE FORCE 
VICTOR AT ANY POINT I 

UE NEED A NAME FOR A COLLECTION OF ALL THESE 
FORCES. ONE AT EACH POINT, • ' 
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learning electrostatics, In addition to the lec- 
ture and text material. Clearly many students 
employed it In this fashion. Also several 
Phvsics 3B problems were structured around the 
field plotting capabilities in the last section 
of FIELD, to be sure that the student had exper-* 
lence with the plotting of field lines; from 
this experience they can gain intuitive under- 
standing for electric fields due to discrete 
charges. 

FIELD was begun by a group of University of 
California physics faculty members on several 
campuses In a workshop -sponsored by the Univer- 
sity to make physics faculty acquainted with the 
"dialogf materials and design approach. Those in- 
volved Included- Sun-yiu Fung (Riverside), Robert 
Eisberg (Santa Barbara), Peter Geissert (Davis), 
Bruce Rosenblum (Santa Cruz), Alfred ;Bork 
(Irvine), Richard Ballard (Irvine). Later adai- 
tions to the dialog were made by. Alfred Bork and 
Joseph Marasco of Irvine. The student programmer 
responsible for FIELD was Thomas Marrs. 

INTEGRAL 

INTEGRAL was also a recommended dialog in the 
Physics 3B course, but for a different reason 
than for FIELD. One of the problems in teaching 
introductory electric-ity and magnetism, is that 
current textbooks tend to make mathematical de- 
mands which go beyond those the student has seen 
In mathematics courses. Although Physics 3B, as 
with similar courses elsewhere, assumes that the . 
students have had calculus^ they will in- general 
not be familiar with the notions of line integral 
and surface integral needed for a full exposition 
of electromagnetic theory INTEGRAL attempts to 
provide this necessary mathematical background, 
and eventually concludes with a discussion o.f 
Gauss's law, one of the fundamental laws* of 



.electromagnetic theory. 

INTEGRAL too is driven from a map, and students 
can use sections of it necessary to meet indiv- 
idual needs 9 . Viewing the usage of INTEGRAL and 
FIELD it can"*be seen that only about half the 
students in the class used INTEGRAL while almost 
everyone used FIELD, 'Furthermore, the average 
time in INTEGRAL was only about half the average 
time in FIELD. 

INTEGRAL wa"s developed by Bruce Rosenblum of 
the University oF California, Santa Cruz, in con- 
nection with the workshop mentioned above. 

DIALOGS 

The statistics on DIALOG^ might appear puz- 
zling uQtil one understands what is involved. 
Although it was used for almosr 700 sessions in 
January, more than any Mother dialog except FIELD, 
the average use of DIALOGS for a single 'session 

'was only for two minutes. Thus, it is'employed 
often, but briefly. I, 

• * 

DIALOGS is an information source, telling the 
student which dialogs are available, and will 
furnish a brief description of •ea^h one. Al- 
though this same information is also available 
in printed form, many .students will not have the 
printed form with them, and wiH use DIALOGS to 
find either the t program they want or as a method 

. of browsing through 6ther dialogs. The students 
use it only briefly in seeking information about 
dialogs. . •> 

Other Comments on Student Dialog Usage 

Briefer comments can be made about some of the 
other dialogs that played a. major role in classes 
in January. CHARGE IB an on-line problem dialog 
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where the student must <juery for information 
a Bout an electrostatic situation to # solve tljg 
problem. t It persuades students to think about I 
what information is necessary i to determine an 
answer as opposed to the usual textbook situation 
where all necessary information is stated. It 
was written by Sun-Yiu Fung of the University of 
California, Riverside.' 

GLEM and NEIL are both lunar lander programs, 
based on simple kinematics. GLEM Is* graphic, 
while NEIL is not. Most of NEIL's use typically 
comes from nongraphic terminals. 

Although MOTION and LUNA do not* show large 
usage for the month of January, in a full year 
statistic they generally £nd up higher than 
other Irvine dialogs. MOTION, was developed by 
Richard Ballard and Alfred Bork. It is an 
"F - ma" simulation, aMowing the student great 
freedom in* the choice of initial conditions*, 
equation constants, scaling, force laws, and 
variables to be plotted.? LUNA, a dialog prepared 
by Arnold Arons of the University of Washington 
and Alfred Bofk, is directed toward understanding 
the phases otf the mooq, using this as an example 
of a scientific model., 

^GRAPH is a different type from any we have 
considered, ft is a utility program, providing 
graphic capability for^ students who do not neces- 
sarily know much about computing. Students can 
type in the functions they want graphejtK The 
dialog provides control of scalin^tfnd 6*cher as- 
pects of graphing. This program receives less 
use now than it did at one time, because we now 
have good graphic capabilities available in APL, 
taught to almost all students in the beginning 
" physic*, courses. 



' ' HOCKEY also follows a different approach from 
others "shown** It was prepared by Robert Eisberg 
of the University of California, Santa Barbara 
and Peter Qeissert of the University of' 
California, Davis. It arrives Aat the notions of 
mass and momentum and momentuiA conservation, 
through computer-simulated experiments of colli- 
sions' of pucks*on a/i air table. Its use In 
January was primarily from Ph*ysics 5B students. 

The OSe of MAGQ' deserves some special mention. 
Tnis program .was used quite beavHy in February , 
1976, where it was a class 'assignment "In the 
Physics OB course.. The s-tudents using it in 
January wer*a presumably those who were somewhat 
.ahead, making use of the. fact that computer dia- 
logs-are always available, to accomplish this work 
before the scheduled period. Thus they offer a 
flexibility not available for lectures and for, 
many other media. . xf 

Finally two of the dialogs Jn the list repre- 
sent primarily developmental work, a$ opposed to 
student access. These two dialogs, CHEM and fcAYS, 
will therefore be« discussed ia the* next Section. 



Project Activity, in January, 



The Physics Computer Development Project was 
als^ heavily involved* in January in the # continuing 
maintenance and development of computer'-based 
dialogs. 

* • 

The largest amount of 'developmental work, as 
seen by its presence in the diaiog*liet above, 
went into the CHEM dialpg*. This is^ the* first of 
the "new worlds** dialogs,- an attempt to produce a 
highly interactive form 'of dialog* where students 
are free „to change the, context of the discussion 
aC^any time. The primary developer is Ricna.rd 
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Ballard. February statistics reflect very * 
heavily the initial use of this program with w the 
introductory chemistry course. 
✓ 

RAYS was developed by William Parker at , 
Irvine, and is an- introduction to the subject-of , 
geometrical optics. It expects to see its first 
student use In the winter quarter. 

Major implementation activities centered 
around dialogs that have been developed with two 
visitors in the' last panrt of December, Arnold 
Arons and Richard Extermann. Arons and Alfred 
Bork developed four dialogs over a two-week 
period, three dealing with magnetic fields, and 
one concerning the difference between tempera- 
ture and heat. Joseph ftarasco and Richard 
Extermann developed a dialog concerning the 
weight of a body on the earth's surface. In 
dialog development in our Project the teachers 
work in a loose tlowchar.t form, specifying the 
pedagogical decisions in complete detail but 
doing none of the actual coding of the material. 
Student .programmers during January were involved 
in implementing these dialogs. By the time of 
the New York APS-AAPT meeting in early February 
it was possible to demonstrate the tlrst of t;he 
magnetic field dialogs; the programmer was 
Martin Katz. N 

Othe'r dialogs were also under development in 
this period: One, SLOPE, is intended for prob- 
lem assistance. Another, SPACE, is an ambitious 
attempt to provide a detailed learning resource 
for relativity. / 

Only one entirely <-new dialog was prepared by 
the Project during the month of January. This * 
was the work of Alfred Bork, Joseph Marasco, and 
John Herman. John Herman, a physics professor 
at Western Michigan University, is spending the 
winter quarter at IrVine on sabbatical from his 
own institution; his primary interest is con- 
verting our dialogs to v run on another system, a > 
DEC System 10. He has also participated in the 
Project in "other ways. The dialog that we wrote 
is a problem assistance and testing dialog, a 
typical electrostatic problem in the first week 
of a beginning electricity and magnetism course. 
This dialog is as yet unimplemented . } 

Another major ' act ivity within the Project was 
the revision ot the course management database, 
a part ot our process of restructuring the be- 
ginning physics course. We had operational a v ( 
database of this kind, to keep track of individ- 
ual ^student records, for the first quarter • 
course, taught by a PSI strategy. The second* ' 
quarter is being taught in a more conventional 
pattern, and so it has been necessary to rework 
the database. Access is provided.to the data for 
K both the instructor and for individual students. 

Finally a major continuing activity of the 
Project during recent months Ras been the 
development of an APL worksapce designe^ to aid 
the process of creating graphic aspects of dia- 
logs., The aim is to provide a facility which 
would be usable by a graphic designer, in the 
sense of industrial design, so that dialogs could 
have a more interesting visual* appearance. The 



work is primarily dOe to one of our student pro- 
grammers, Mark Geisert. The programmer or de- 
signer can construct graphic or alphanumeric 
irnag^, can move these around the screen by means 

, of the built-in graphic pointer, can change the 
shape of the objects, can rotate them, can torn- 

, bine simple objects into composite objects, and 
can manipulate them in various ways. Control 
"over text includes the ability to right justify 
and left justify, to center 'it, and to enter sub- 
scripts and superscripts. The program will itself* 
write the computer code necessary to generate the 
graphic and alphanumeric images specified, and 
this code can be merged with that generated 
directly by programmers. This facility is proving 
to be very useful in all our recent dialog de- 
velopments, including those mentioned in the 
present paper. 

It should be stressed again that looking at any 
one month will give certain biases. Thus, the 
dialogs that received very heavy use were acci- 
dents of the particular class activities. §ut 
the general* "flavor" would be the same. 

The project is happy to send literature about 
its activities and to welcome visitors. 
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TWO CONSUMER VIEWS OF PLATO IV 



John W. 



Robson, Department of Physics 
University of Arizona 
Tucson? Arizona 85721 



ABSTRACT t rte Laboratory for Computer Based Instruction at the University of Arizona has operated 12 

terminals connected to trie PLATO IV system for approximately a year. Thus we are consumers of a service 

provided ty the *Computer-base& Education Research Laboratory* of the University of Illinois, Students in 

selected courses*at the University .of Arizona are consumers of instructional material delivered by PLATO. 
/ ♦ 

We intend to report on a year of experience from the viewpoints of these two consumer groups. 

f . / 
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DESIGNING CAI PACKAGES FOR COMPUTER SCIENCE 

Donna Hutcheson 
East Texas State University 
Commerce, Texas 75428 



f • . 

ABSTRACT: Computer Assisted Instruction (CAI) is proclaimed by many to be the cure for all educational 
ills. Even though that is not an accurate assumption, tAI is an excellent tool to assist instruction if 
adequate application packages are available. Research has^shown that one of the most neglected areas of 
concentration for application packages is computer science! Why? Generally persons proficient in computer 
science are not knowledgeable in the techniques for designing an effectived nstructional package. To 
design an effective package the following steps should be employed: 1. Select a topic, 2. Define 
measureable objectives, 3. Write Pre and-Post Tests, 4. Select-instructional strategy, 5. Identify and 
prepare additional audio-visual materials to accompany course, 6. Code course material in an author 
language, 7. Functionally debug the course, 8. Conduct peer group, tryout and revise, if necessary., 
9. Conduct target population tryout and revise, if objectives were not met, and 10. Periodically review 
and maintain package. - y r 



Introduction 

For the purpose of this paper, Computer 
Assisted Instruction (CAI) will be defined as us- 
ing the computer as a tool for helping students 
attain the objectives for a module of instructipn. 
Research in CA* since the inception of the concept 
has produced numerous articles ^claiming the 
excellence of CAI as an educational toolWr^One 
would think that due to the nature of CAP, computer 
science education would be the leader in CAI use. 
Yet, research conducted by Pati Smith of East 
Texas State University during the fall of 1975 f 
shows that one of the most neglected areas t>f con- 
centration for CAI application packages is computer 
science. It has been stated by some educational 
experts that professional educators could not 
write efficient CAI packages because they could 
not program the* computer, and computer programmers 
could not write effective packages because they 
were ^familiar with either the course material or 
with instructional strategies which could improve 
the probability for student attainment of objec- 
tives. Computer science teajchers are familiar • 
with both Instructional strategies and. programming 
techniques. So why is there not a multitude of 
computer science courseware available? 

1. Many teachers feel that they do not have 
the^hours of time€hat it takes' to 
develop materials/, 

2. Most materials that have been written are 
not documented, and thus are useless to 
anyone other than' the 'author. 

3. Not all institutions use the lame author 
language, or the- same computer equipment, 
-making exchange of*materials difficult. 

4. There are no clear-pift guidelines avail- 
able for. writing and implementing CAI 
packages. 



^ This paper addresses the last reason--guide-, 
lines for developing CAI packages in the area* of 
computer science. The'following systematic approach 
has been successfully use,d at East Texas State 
.University to train prospective computer science 
teachers to write effective CAI courseware. 

1. Select a topijp . ^ 

2. Define measureable objectives > 
r 3. Write pre and post tests / 

4. Select instructional strategy ' 

5. Identify and prepare additional audio- 
visual materials to accompany course 

6. Code course material in an author 
language 

7. Functionally debug the course - 

8. Conduct peer group tryout and revise, if 
necessary ^ 

9. Conduct target population tryout and 

revise, if objecti ves'were not met 

10. Periodically review and maintain package. 
* * 

. » 4 Steps^l-3 make up the design phase;^steps 4-7, 

* the* implementation- phase; and 8-10, the Hal Bat ion - 
phasfe. Many ..beginning authors plunge directly into 
the implementation phase and fry to^write an effec- 
tive coursje without first considering the steps 
involved in the design phase. Experienced CAI 
author/programmers generally agree that from 25 to 
40 percent of the total time required to produce 

* an efficient CAlf -module is spent- on design. Thus, 
time spent on the first three steps listed above 
will save fime and frustration in the long run. 
' & 

Select a Topic 

The fjrst step, selecting a topic, is more / 
, difficult than firs^ consideration indicates. Any 
^teacher may be capable of designinq antf us'ing 

• instructional materials; but can the material 
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well adapted to CAI, and is it worth learning?' 
Before investing the hours of work that it tgkes* 
to design an effettive 'CAI module, be»sure that 
' there is a need for the material as evidenced by 
students, teacher^, and lack of similar materials. 
Also, will the segment be used once it is written? 

Novice author/programners should beware of 
using CAI to teach concepts which are tradition- • 
ally boVtny even whwr presented by the most 
innovative teacher, such as history of computers. 
In the past, most courseware for computer science 
has concentrated on teaching students the syntax 
and semantics of a particular programing language, 
thus leaving the teacher free to concentrate on 
the refinement, of programming techniques. As the 
author/programmer gains .experience, more challeng- 
ing topics should be considered. 

No rrtattor which topic is cKosen, state t3^e 
scope of eacn module or sub-module in precise terms, 
including the sequence in which the tasks are to ' 
.be presented. Keep in mind that some tasks may 
*not have an inherent sequence if they are pre- 
requisites to a future task, but not prerequisite 
to each other (i.e. I/O devices or storage devices 
as prerequisites to evaluation of computer systems). 
Such tasks may, be presented so that the student 
chooses the sequence of tasks to be completed. 

Define Objectives »^ 

Once the topic has been selected and the 
scope defined, it is necessary to define measure- 
able behavioral objectives. Authors who eliminate 
this step in the design phase often are frustrated 
later when asked "What exactly is a student 
supposed to learn from this course?"- and "How- do 
you know that the course taught anything?" The 
worth of CAI is particularly dependent upon well 
defined objectives in the face of traditional 
educators' criticism. 

Write Pre and Post Tests 

Now that the objectives have been identified, 
writing pretests and post tests is a simple matter. 
Many ijyjructors arfd curriculum designers eliminate 
pretesxs if the content of the module is of an 
introductory nature and no prerequisite or entry 
level knowledge is necessary. However, if pre- 
requisite .knowledge is necessary for the student 
to succeed in any given module, a pretest is man- 
datory. If the student does not successfully pass 
the pretest, provisions for remedial materials or 
instructions as to what the student is to do next 
should be provided. Comparing the results of pre- 
tests and post tests can make learning justifica- 
tion arguments much easier. If the answers to the 
pretest questions are not given to the student at 
.the time he makes a response, the same questions 
could be .used in the post test. If the same ques- 
tions are used, the measurement of student 
learning contrlbutab^e directly to the CAI module 
is much easier. Naturally, different questions 
may be usedVn the post test. However, be sure 
that all questions are consistent with the 
previously stated objectives.' 



Select Instructional Strategy 

At this point it w|ll be Necessary to deter- * 
mine the logic of the instructional strategy. The 
development of an effective instructional strategy 
requires imagination and creativity. Three factors 
should be considered: 

1. the level of interaction between student 
and courseware to be utilized; 

2. the teaching logic; 

3. the decision algorithm to be used to 
select each student's pAh through 

« instruction. 

The level of interaction plays an important 
part in forming the student's reaction to CAI. 
'Two primary levels can be identified: free-form, 
short-answer constructed responses, and objective- 
type responses (i.e. yes-no, true-false, multiple 
choice). At the present time most courseware 
contains the objective-type, response format 
because constructed responses are more difficulty 
to process. However, it is the opinion of this 
author that computer science authors should strive 
for constructed responses since it is only by 
"doing" that a student truly learns. 

The teaching logic is primarily dependent on 
the level of interaction chosen. The following 
teaching logistics iq order of complexity are*** 
available:. 

1. Drill and practice 

2. * Tutorial 

3! Problem solving 

4. Simulation 
, 5. Inquiry 

Tutorial logic is most appropriate for teaching 
introductory concepts in computer science,* but 
requiring the student to apply learned concepts 
implies the use of either problem solving or 
• simulation logic. It is suggested that the author/ 
programmer try to incorporate a combination of 
two or three different methods in order to give 
the student a variety of experience, thus promoting 
a more complete understanding of the topic. 

The decision algorithm controls the sequence 
of instruction. The algorithm used can range from 
a simple linear plan to a complex plan involving 
branching and numerous paths through instruction. 
To take full advantage of CAI *5 capabilities, a 
simple linear plan should be avoided. In the 
complex plan, the particular path .that an individ- 
. ual student takes is dependent upon his perform- 
ance pn previous questions. Figure Illustrates 
a simple linear plan; Figure 2, a s 1jQ}pJL£_h£ancliinQ, 
plan; and Figure 3, a complex plan. Note that the 
sequencing plans presented in Figures 1-3 may be 
used for both tutorial logical and problem solving 
logic. There are infinite variations of strategies, 
between the simple linear plan and the complex plan 
presented. The particular strategy used should be 
based upon the complexity of the material being 
presented and the personal teaching style of the 
author/programmer. No matter which strategy 1s 
devised, 1t should be flowcharted for easier * 
reference when coding the course into a program-, ' 
ming language for the computer. 
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Figure 1 

Instructional Strategy 1 - Linear Sequence 
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Instructional -Strategy - Simple Branching Sequence 
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Identify and Prepare AV Materials 

Often additional media are required to commu-' 
nicate the instructional message to the student. 
The author should examine the lesson v f low to deter- 
mine which learning activities wi VI be used to 
attain the objectives. Then the additional media 
to be used with those learning activities must be 
identified. j- 

Additional materials could include: 

1. Supplementary reading to avoid placing 
several sxreens of text for the student 
to read. Too often authors use the 
computer to simply present textual 
material to students. This practice is 
strongly discouraged. ■ 

2. Real objects Jike disk, tape, core rings, 
card decks, etc. a 

3. Audio tapes containing perhaps' the 
teacher's explanation of a difficult 
concept. 

4. A film, filmstrip, or videotape., presenta- 
tion of tutorial material. * 

However, keep in mind the following points when 
selecting additional media: 

*\ l ' 

1. time required to develop audio-visual 
materials; 

2. compatibility of media selection with the 
computer terminal in use;j 

3. appropriateness of the selected media to 
the activity— Is it better than any other 
media? 

Due to the time involved in preparing additional 

materials, production of these materials should 

begin at this point. , i 5 



Code Course Material 



V 



Now the author/programmer should be ready to - 
write and code £he course in an author language. 
There are numerous author languages available for 
coding .instructional materials using the computer 
in an ioteracti ve. mode. Among these are Course- 
writer HI, APL, Basic, Tutor, and Scholar. The 
language used at East Texas State University is 
IBM Coursewriter III. Coursewriter IJI, an IBM 
author language designed exclusively for CAI, 
is easy "to learn and easy to use. Much of the 
processing logic is inherent in the operation 
codes (i.e. when the student answers a question 
correctly, control is automatically passed to the 
next problem unless routed elsewhere by the pro- 
grammer.) Also, partial answer processing capabil- 
ities allow realistic interaction (eg. when two 
words are required as <a correct answer, if one 
word is correct, the student can be told this fact 
and asked to change the other word.). Rather than 
expound upon the details of Coursewriter III, 
interested readers are advised to reference the IBM 
Coursewriter III Author's Guide. 

Note that there is no perfect author language. 
Each has virtues and faults. If you have not 
selected an author language, some points to keep 
in mind are: 



4. 
5. 
6. 



Is it just a computer language or is it 
designed* for use in CAI? 
Is it easy for both students -and faculty 
to learn and use? 

Is it transportable? (i.e. Can it be used 
on other computers?) 

Is it supported by your computer vendor? 
Have other educators used it? 
What types of terminals are supported by 
the language? 



No matter which author language is used to > 
code the material, avoid t the use of pat feedback - 
^to student responses;, such as right, wrong, 
correct, incorrect. These kinds of "pat responses 
to the student give CAI its, "dehumarfi zing" reputa- 
tion. Give hints, allow for unexpected answers, 
and provide a way to proceed to the next question 
other than by giving a correct answer. In other 
words, write a flexible program that will truly / 
individualize instruction. / 

Nothing that has been written. is perfect the 
first time. Much rewriting and recoding is 
necessary to develop a smoothly flowing program 
of instruction. .'Always keep the student in mind. 
Present the material in small, logical steps so 
that the student can establish closure with 
previously discussed points. The purpose and 
importance of each point toward the final goal . 
should be stated. Use numerous break points for 
re-entry if the student signs off and review 
points if the student demonstrates confusion, or 
skip ahead if the student demonstrates cqmplete 
mastery of a specific objective. , 

- Debug 

Unfortunately, vSry few compUter..programs 
execute successfully the first time. Therefore, 
time must be taken to debug the program; that is, 
get all of the programming errors out so that it 
will .execute successfully.^ Unique to CAI programs, 
is the need to search for misspelled words, 
sentence structure, and screen formatting errors, 
if cathode ray tube terminals are, used. Often 
the answer processing statements do not function 
-as-or-iginally anticipated. Thus, many trial 
executions must be completed to find all of the 
errors. ' Try all of the anticipated responses as 
well as a few unanticipated responses to test 
execution of all student paths through the program. 

Peer Group Tryout t * 

The evaluation phase is often overlooked by 
author/programmers. They tend to feel that once 
a program executes successfully with their test 
data, it is complete. For CAI programs, author 
testing is not sufficient. If the instructional 
package is to have substantial, use by anyone other 
than you, p,eer group tryout is essential. Ask two 
or three fellow teachers in your department to 
take the course as students and make suggestions 
for improvement of the instruction or the answer 
processing. Teacher peers are valuable critics. 
Analyze their comments and if you feel that the 
suggestions are valid, revise the moduli. If 
'additional coding is. involved, then go back to 
step 6--coding*the, revisions. 
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Target Population Tryout 

After the package fjas the " seal of approval" 
from teachers, it is time for the real test- 
students. Test the program with a small group of 
students having the characteristics of the target 
population. For instance, if the module teaches 
syntax of Fortran fV, test it with a section of 
Introductory Fortran IV students. Even though the 
program statements are syntactically correct, 
students very often do not perform as expected. 
Weak points in the instructional strategy or the 
programming will probably be identified. If the 
objectives of any module were not met, as indicated 
by student performance, major revisions may be 
necessary. If necessary, revise -and reoode. 



obvious that the computer science teacher fieeds 
all the help or she-can get. This is 
especially true wit& the n£w trends emerging in 
programming and design techniques. Thus, computer 
assisted instruction may well enable the computer 
science teacher to offer a more complete course 
if adequate application packages can be developed. 
Arfb they can, if master teachers will take the 
time to follow each of the steps outlined. The 
net result of such effort will be more precise, 
yet comprehensive, instruction* for the student. 



For a true evaluation of the instruction, 
compare the competencies of those using CAI with 
the competencies of a group of similar students 
being taught the same material using other media. 
Such an evaluation procedure w*s conducted at 
East Texas^Statej University by the author of this 
paper with respect to learning Coursewriter III. 
It was found trtat students who received tutorial 
CAI instruction H^arned thq desired concepts as 
well as those involved in the traditional class- 
room environment, but in less time.. An inter- 
esting fact was discovered with a third group who 
were exposed to both CAI and traditional instruc- 
tion - this group out-performed the other two 
single-method groups by an average of 20%. 

Review and Maintain 
— ■ * 

Finally, the -package has passed all tests. 
Oon't put it into production and then forget about 
it! Periodically review th> materi al ^analyze the 
comments made by the students concerning areas 
difficult to understand; and anaVyzeTstudents 
unexpected wrong answers!. You may^need to continu- 
ally revise various parks' of the program to allow 
for individual student (inferences and to keep the 
content consistent withfcurrent advancements in 
the area of computer technology. » 

Documentation 

One final point, documentation is extremely 
important not only to conserve time and effort on 
the material being developed so that other 
instructors may use it, but also as an' aid to 
preparing additional modular units. When no 
documentation exists, the life of the package 
is doomed to be short. All of the following should 
be^placed together for documentation 1 : 

1. definition of the topic (scope and 

sequenced tasks) 
2* list pf student characteristics and pre- 

skills (entry behaviors) 

3. definition of specific objectives (in ' 
measUreable terms) 

4. flowchart of Instructional strategy * 

5. audio-visual materials. 




Conclusion 

When one examines the large number of topics 
which are recommended for inclusion in computer 
science courses by curriculum committees, it is 
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THE COMPUTER — A PERSONAL TOUCH 



Dennis H. Sorge 
Purdue^ University 



ABSTRACT: For, many years Purdue University has hand processed a report of studehts 
doling unsatisfactory work. Id 1969 the Calculus committee of the Department of Mathe- 
matics Wanted a* more effective system for reporting to academic advisors calculus stu- 
dents doing unsatisfactory wqrk on homework, quizzes, or tests or having excessive 
absence 1 . The calculus reports in 1969 and 1970 still made too little use of a computer 
and too much use of clerical time. It was decided in 1971 that to, be effective the 0 
•system would have to be largely computerized. From Registrar supplied computer tapes 
the .initial data base was created: a system for updating records was started; pro- v 
grammers began preparing software. With each new feature additional software and 
logistic problems had to be solved.. Beginning Fall, 1973 all 12,000 enrollments in 
Computer Science, Mathematics, and Statistics were part of the data files. This pro- 
gram for monitoring students' progress influenced the development of a many faceted 
administrative computer system. Today the Division of Mathematical Sciences has a 95% 
computerized reporting system, an enrollment update system, a teaching assignment update 
system and other support operations. In FaJ.1 1975 the University Provost's office 
requested that all Freshmen in all courses at the university be included in this delin- 
quent student report system. Successful results on a larger scale would suggest* a possi- 
ble' replacement for the university hand-prepared reporting system. About 5000 delin- 
quencies were reported from a sample of over 40,000 enrollments. This close monitoring 
and subsequent personal contact is a reality only because of a computer. 



It is not at all unusual that a col- 
lege* or university eadh semester should 
prepare a list of students who are 
doing unsatisfactory work. This is cer- 
tainly the case at Purdue University. 
For many years this report of students 
8oing unsatisfactory work, known as 
Delinquent Students Report, or yellow 
slips, has been a hand-processed report, 
instructors were asked to pick up, com- 
plete and return the data gathering 
forms. To complete this mid-semester 
report of unsatisfactory work instruc- 
tors were required to supply the stu- 
dent's name, socialvsecurity number, 
university^ identification number and 
school of enrollment and' sign the state- 
ment that the student 1 s work was unsa- 
tisfactory. Many instructors felt that 
it Was too much trouble. Jdany academic 
advisors felt that it supplied insuffi- 
cient information and that the report 
arrived too late to be effective. ' 



The decision to computerize 

. i 

Partly because of these reactions 
the Calculus Committee of the Depart- 
ment of Mathematics decided in 1969 to 
develop a more effective system for 



reporting delinquent calculus students to 
their academic advisors. The committee 
did not know how the system was to 'be 
made operational but they did know that 
it should report information about the 
student's homework, quizzes, tests and 
absence. It was also decided the report 
should come out as soon as possible after 
the firs,t examination which was ab'out the 
fourth week of the Semester. 

To create the reports in 1969 and 
1970 instructors were asked to subtly 
the names of the stude'nts who had Tlurned 
in less than^half of their homework, who 
had scored less than half on quizzes, 
and Who had excessive absence. The office 
responsible for producing the report, 
known as the Calculus* Office, already had 
test results since it regularly maintained 
records on, students 1 scores. Three cler- 
ical people spent almost three" weeks col- 
lecting and sorting data" and preparing 
reports that listed students alphabeti- 
cally within their school of enrollment* «. 
Unfortunately, this procedure .only solved 
one of the three problems associated with 
yellow 31ips\ More information was repor- 
ted but it was still cumbersome for the 
instructors to supply and it still took 
.too long to generate. 
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To simplify the reporting procedure 
it" was decided that instructors would.be 
. sent preprinted listis containing the 
*names of the ir % students, the social 
security number^and the school of 
enrollment. However, to do this required 
that the Calculus Office keypunch all the 
classlists for the calculus courses and, 
using a computer program, sort and print 
these lists. This succeeded in simpli- 
fying the reporting procaas somewhat for 
instructors but^it creatidNm almost 
impossible burden on the Calculus Office 
sincd there are usually 4,000-5,000 cal- 
culus* students at Purdue. » 

Investigations into how to elimi- 
nate the need to keypunch classlists led 

^to the discovery that the Registrar's 
Office would supply* computer- €apes con- 
taining the information needed, with 

_this support it was decided in 1971 that 

"to be "affective this system must be 

„ largely computerized. , 



Building a data ba3e 

Initial contacts were* made with the 
Registrar's Office to ascertain what 
types of data tapes could be obtained 
from the5>. "'Tape formats and loading 
problems were discussed. The, first stage 
of developing this reporting system was 
to write, programs which 'would create ^ 
classlists on .which instructors could 
record delinquencies and so that the 
Calculus Office would not have to key- 
punch this information as they had done 
previously. ^* , 

By the fall of 1972 we succeeded in 
overcoming the problems resulting fron^ 
computer incompatibilities. Tapes were 
created on IBM 370 equipment; the Galcu-. 
lus Office was building* its files using y 
Control Data 6600 hardware; tapes in 
6000 character blocks had to be split to * 
avoid special tape drives; 800 bpi den- * 
sity was reduced to 556 bpi to eliminate 
superious parity errors. Computer soft- 
ware extracted names and social* security 
numbers from one tape and course and 
division of enrollment from another. It , 
then produced, a punched card containing 
this information* Another program pro- 
duced lists of student names and column 
headings under which instructors, cqtlld 
mark if students had turned in le*ss than 
half jtheir homework, scored less thaji 4 
half on quizzes or whether they had b,een 
absent excessively from class.' When this 
information was returned to the Calculus 
Office the cards for those students 
reported as delinquent were removed from 
the initial decks and sorted by school of 
enrollment and by course % 

Thes£ cards then were used to gener-. 
ate a report to counseling offices. This 
report' had a iead paragraph, the stu- 



dents 1 -names and? social security numbers 
listed by a program. But it was still 
necessary to mark "£y hand areas in which 
the students were reported as being delin- 
quent. * It was now easier for instructors 
to report delinquent students. However, 
the amount of paperwork f6r the Calculus 

•Office was still too great. 
« • 
The difficulties with this system 

Jiad to be improved. There must be some 
way for instructors to report student 
delinquencies that could be mechanically 
processed*. It should also be possible to- 
produce lists for academic advisors with- 
out requiring any hand work. 

At this stage a critical assessments 
was necessary and major decisions had to 
be made. They were as follows: The 
entire system must be reassessed and in 
fact completely rewritten and redeveloped. 
The small patchwork FORTRAN programs 
would be eliminated. COBOfc programming 
would be used because its self documen- 
tary nature provides for easier transi- 
tion from one programmer to the next and 
because its file definition and manipula- 
tion procedures were appropriate for the 
system being developed. A 95% compu- 
terized operation would be the goal. A 
study of input media and available hard- 
ware led to the decision that data would 
be collected from instruqtors by using a 
semi-mark sense computer «*ard. The uni- 
versity had facilities for sensing and 
punching the marks into the card. Proce- 
dures and equipment that would permit the 
use of optical scan sheets were not avail- 
able. Computer programs wduld create 
initial data banks and from these data 
banks the semi-mark sense cards would be 
punched with the student 1 s name and class 
identification. Appropriate places would 
be darkened for any delinquencies to be 
reported. The cards were ordered and the 
programming began. 

As the system was developed and r the 
programming progressed it became obvious 
that there were additional problems that 
had to be solved. One of the items 
repbrted on delinquent reports is- the 
students test scores. For spme time the 
Calculus Office had been collecting infor- 
mation about test results. If this infor- 
mation were in a form suitable for compu- $ 
ter] input, it could be fed into the data 
banks so that it would no longer be neces- 
sary to ask instructors about test 
results. Since there are always excep- 
tions to this, the option of reporting 
test scores using the semi-mark sense 
"card must be maintained. Also necessary 
was the development of a system for grade 
changes. It was important that if a stu- 
dent dropped a course, he would not be 
reported as delinquent. This brought up 
t}ie entire subject of a continuous up- 
dating of the data files. All dropping 
and adding of courses would have to be , 
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recorded and ail changes within courses 
would have to.be determined. 



The system grows 

In the spring of 1973 the .first 
nearly totally computer generated 
report was produced. However , .. many, of 
the problems already discussed had not 
yet been solved. Record updatiny Was 
still not functioning. We had dealt 
with hardware incompatibilities, with 
software problems and now we had to 
handle administrative difficulties. 

The system would not be ^efficient 
unless all student enrollment changes 
could be recorded and processed in one 
location. Since distribution of mark 
sense cards required information about ^ 
instructors the entire area of .computer- 
ized record keeping on teaching assign- 
ments began to develop. 

The spring 1973 report generated for 
the calculus courses. was so well received 
by academic advisors and instructors that 
there were requests to include in the 
reporting system courses other than the 
calculus ones. Because of administrative 
responsibilities of personnel involved in 
developing the system and because of the 
nature of the growth o£ the system it 
was decided that the da£a banks would 
contain all students enrolled in any 
course" in Mathematics, Computer Science 
or Statistics at Purdue University. This 
meant that up-to-date data tapes on 
15,000 enrollments .would be maintained. 
During the fall semester 1973 two reports 
were produced in the first eight weeks 
of the semester. Approximately 6,000 
students were being monitdred for this 
report. Several hundred qf these were 
reported as delinquencies. Getting this 
far, however, had required nearly four 
years devoted to the development of 
software and logistic patterns condu- 
cive to effective operation. This alone 
would perhaps not have made the program 
successful had it not been for adequate 
administrative support. This support 
encouraged instructors to maintain 
accurate and up-to-date records of their 
students* progress. With accurate # 
records it was now possible to reduce 
instructor reporting time to not more 
than ten seconds per delinquent student. 
The Calculus Office had- reduced its non- 
computer work to the distribution of 
cards, the collection of cards, and the 
mailing of the final reports. 

The administrative system that had 
developed out of this request for repor- 
ting delinquent students was yet not 
fully* developed. There were still logis- 
tic rough spots. The problem of record ' ■ 
updating had to become a smooth, routine » 
operation. Enrollment changes, alone 



number 3,000. Procedures were established 
and printed in a checklist format. 

<. f- 

With these problems solved, the 1974- 
75 academic year proved to be a very suc- 
cessful reporting year. Instructors were* 
routinely asked twice during the semester 
for information about their students. The 
number of students involved had now grown 
to approximately 7,000. Whereas in 1969 
l^Lt had taken three clerical people nearly 
£hree> weeks to complete this report, the 
clerical time now' had been reduced to lit- 
tle more than two hours for one person. 

The reports were praised by academic 
advisors across the campus. They £ound 
them very helpful because they contained 
sufficient information and they came at a 
time when changes in enrollment or istudy 
habits coUld still be brought^about . 
Likewise instructors had no complaints 
beqause reporting delinquent students was 
now a very simple procedure.* The deper- 
sonalizing effect often attributed to the 
computer had made it possible for instruc- 
tors and advisors to m show and successful- 
ly communicate a personal concern for 
their students 1 academic success. 

c 

Research during the' i973-74 academic 
year showed that the report was successful 
in getting many students to improve the 
quality of their work or in getting many 
students to drop courses before receiving 
a failing gra3e. The research also 
showed that every student who received a 
failing grade in "one of the courses for 
which delinquent reports were produced 
was notified at least once during the 
semester that his work was unsatisfactory. 

"There were several significant side 
effects resulting from the development of 
this reporting system. Once there were 
as many as 700 students out of 15,000 who 
were not attending the division of a 
course in which they were enrolled and 
never located in their specific class. * 
With this system and record updating it 
was possible within a year's time to 
reduce that number to approximately 25. 
Additionally, a data retrieval system was , 
developed which took the initial tapes 
supplied by the Registrar and produced 
many, many forms of assorted output. 
Research that was once not possible 
because of the inability to obtain the 
data in a desired form now became routine. 



University applications * 

General university-wide dissatisfac- 
tion with the 'yellow-slip* reporting 
system Jnentioned earlier caused the uni- 
versity Provost's office to request that 
the calculus Office, now called the Office 
of Undergraduate Services, include in its 
reporting system on a trial basis all 
students who are freshmen at the 



university. 

During the fall semester 1975 'nearly 
40,000 semi-mark sense computer cards 
were produced and distributed to facul- 
ty across the university. All freshmen 
students in all courses Here now subjects 
for delinquency reports,. Nearly 5,000 
delinquencies were reported via these 
semi -mark sense cards and at about the 
seventh week of the fall semester a 
report was generated and sent to aca- 
demic advisors. * The problems tfcat »pre- 
sented themselves during this extension 
were distribution, collection and defi- 
nition of terms " — homework, quizzes, 
test. None of the problems were computer- 
related. 

The total system was not used in 
this reporting, only that part of it 
related to the reporting of delinquent 
students. So, in some cases, students 
who had dropped courses may have been* 
reported as being delinquent. . Neverthe- 
less, this did not detract from the effec- 
tiveness of" this program. Many addi- 
tional difficulties surfaced at this 
time. Among these were that many instruc- 
^ tors did not keep accurate and up-to-date 
records; many students were not evaluated 
until nearly half-way through a semester; 
and even with this simplified reporting 
system some instructors did not wish to 
bother. Nevertheless, the success of the 
program was far greater than its faults. 



It was apparent that the logistics 
involved in handling nearly 40,000 compu- 
ter cards is a greater proMem than it <• 
should be. But since the university 
Registrar's office decided that the^r 
would begin experimenting with ..this s^s^ 
tern and would use their new facilities 
for optical scanning to gather data, 
this problem woul^d be solved. Semester 
grade reporting, already an optical 
scan procedure at Purdue, would serve 
as an excellent media for the delinquent 
student report. Format changes ° seemed 
to be the only necessary variations. 

Almpst all of the computing problems 
in^jthis system have been solved* The 
.pvjor concerns now involve administra- 
tion and faculty. When additional 
cooperation and improvement in record 
keeping and evaluation is brought about 
the reporting system will show its great- 
est potential. Successful "experimenta- 
tion with selected classes and optical 
scan reporting sheets will result in 
university-wide- replacement of the an- 
cient yellow slip hand-processed repor- 
ting system. n 

\ One factor that must always be con- 
cerned in the development of any system 
is the cost. The computerized system of 
reporting delinquent students used for 
monitoring and subsequently reporting all 



delinquent freshmen students during the 
fall semester 1975 costs only about |300. 
This cost included cards, computer time 
and student help for distribution and col- 
lection. Operational costs university- 
wide should be in the $2,0Q0-$3,000 range. 
Developmental costs spent from 1969 to 
the present were about $5,000. 

This is a very small cost when com- 
pared to the expense for students and the 
university resulting from students unsuc- 
cessfully completing a course. Most im- 
portant of all, by using a machine to 
store and rapidly analyze large quantities 
of information, to temporarily remove the 
human element/ has permitted instructor's, 
advisors and -administrators to show more 
concern, guidance and consideration for 
students. In this area at a large uni- 
versity the computer has contributed to a 
personal touch. 
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THE FUTURE OF COMPUTER ASSISTED INSTRUCTION: 
A SUMMARY AND ANALYSIS. OF THE CARNEGIE COMMISSION 1&EP0RT - $ 
COMPUTERS AND THE LEARNING PROCESS IN HIGHER EDUCATION 



C. Edward Streeter 
Professor of Information Sciences 
Illinois State University 



ABSTRACT: The purpose of this' paper is to stimulate thinking and discii'ssion about the misuse and 
potential of computer assisted instruction. The central focus of the" paper is an examination of 
existing and potential computer support to instruction based on an analysis of the learning process*. 
A look is taken at the effectiveness of these uses in terms of possible equally effective but less 
costly alternatives. 



Hu«> paper is> a summary and analysis of a 
report [ft. pa red for the Carnegie Commission pn 
Higher fdm it ion, Computers and the Learning # 
ri*ilV* i 1 H ifetter E dm at lon by John Rockart and 
Scott Morten of the Sloan School of Management, 
Mjs's n h»s« tts Inst itute of Technology. 

Hi h n going into the report itself, let me 
givi vim sv>mo background information that 'will 
ht M 1 . u understand the biases from which this 
Mjnu..ir iivl analysis is done. 1 spent my entire 
public si h«»ol career 1948-1964 in Iowa as a math 
teaciicr, ouh, principal, superintendent, cur- 
riculum <md instructor consultant. I was working 
<is cum* ulum- instructor consultant in Keokuk, 
Iowa, whrn offered an »OEA Instructional Tech- 
nolog\ f t 1 lowship'^o work on a doctorate at 
Michigan State University. My reaction was, now 
1 will loam what I am supposed to know in my work 
as an instructor consultant. After three years^ of 
sttidv md eight vears. of trying to apply what *I 
had leirneM. I have come to one basic conclusion: 
rile re i s a lot wv do not know about how people- 
learn and how » to instruct. 

Mv interests lie in the utilization of all 
t\pt-s of instructional media, and particularly in 
the development of models and schemes for selec- 
tion and utilization of instructional media. My 
present teaching/research interest is the appro- 
priate use of various instruct iohal media in 
teaching a computer literacy course in two formats: 
regular classroom and guided independent' study. 
As we get into the work of Rockard and Morton, you" 
will see mv interest in preparing" this paper and * 
looking forward to interacting with you about it! 

RocJ*w4,nnd /Morton focus on computer supported 
instruct ion ^cfemputef' Assisted Instruction (CAI) in 
the broad sense) as opposed to computer managed 
tnstruvtion or instruction about computers. Their 
real comero, however, appears to be the develop- 
ment oT a model for the appropriate selection of 
all types of instructional media; a concept that* is 
needed for all levels of teaching, not just higher 
education. * * % 

Their report comprises ten chapters and 356 
pages, including an appendix. The first part of 
the book is. introductory and background material. 

3iree important questions relating, to effective 
il utilization are presented, followed by a dis- 
cussion of the teaching and learning theory , CA1 
hardware and courseware, and some' descriptions of 
CAI projects. Except for the three quest ions, 
this background material will "not be covered in 
tjiis summary. • 
« 

The three questions they suggest need answer- 
ing are: (1) Can CAI be cost effective?, (2) In 
what specific ways wild the computer effect the 
learning process 4 in h'igher^educat i<mk and (?) How 
should a. faculty member approach th^^select ion 
of one o.r more of these tvpes of CAI for a, par- 
ticular fours' e *>f study? 6 » 

i 

Chapter s.ix is the ''heart'" of, the report, 
development oT a plan to match t«n:hn*logv to 
learning.' While Civipfer six reports what the 
'Authors 'think ought to be, the next chapter reports 
on what fca, using n 19-75" survey of CAI in 



Massachusetts higher education, latter part 

of the book examines the environmental and in- 
ternal constraints affecting CAI adoption in* 
higher education, the author's conclusions, and 
the: appendix. 

My summary and analysis deals mainly with the 
development and application of Rockart and 
Morton's system for selecting the most appro- 
priate uses of computers in the learning process. 
They start with the general learning model as 
shown in Figure l. v 

/ Accuse baS'C rv* 




Figure 1 

In the initial stage, acquisition , the 
learner is exposed to basic data, skills, and 
concepts. The second stage, inbedding , has the 
student pracl9fce and/or ppnder his newly acquired 
knowledge or skill. Duririg the integrat ing 
stage, he assimilates the new inYormation into 
his exist ing Cognitive structure of the world, 
and the fioal stage is testing his learning in 
new situations: Tonc'rete' or simulated. 

The other element of the learning matrix, 
shown in the "left column of Figure 2, is a cate- 
gorization of materials (Course content). These 
four categories are described as follows: 

1) Facts , including definitions dnd other 
basic information relating to specific* 
single items or ideas. ' ? 

Z) Skil Is , including both procedures and rules 
and their applications. . 

.3) Established concepts , as well as other 
theories, hypotheses, postulates or 
assertions that, are well enough established 
to be of no interest to 'the current re- 
searcher in the field. "Concepts" use . 
* "facts" as basic building blacks. 

4) Frontier concepts , including not only 

recent development but also long standing 
issues which either have not been or can- 
, not be* resolved. 
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Figure 2 

The next major step in the development of 
their scheme is a grouping ©f available learning 
mechanisms described in an earlier chapter; these 
are as follows: ♦ 

lecture, case study, class discussion, 
tape* radio- „ 
visual aids, film, video tape, 
cable, TV. 

textbooks, programmed instruction, 
study modules, written assignments, 
tutorial, drill and practice, problem 
solving, inquiry, simulation, games, 
laboratory experience, real world ex- 
perience. 

Sixteen attributes are then identified which 
each of the above learning mechanisms contains to 
sfcme degree. These attributes are categorized and 
set forth in Figure 3. Both the categories and 
the attributes are somewhat self-explanatory, and 
time will not permit a detailed discussion here. 
A cross-section of MIT faculty were asked to rank 
each of the learning mechanisms in terms of the 
degree each mechanism possesses the various attri- 
butes. 

A Content related 

1 Ability to telescope r^ne 

2 Ability to present structure 

3 Provision of a nch environment 

4 Ability to provide ilMrxuctured material 

5 Flexibility for adding new material quickly 
c^^pport for the learrfrV structured* clencal tasks 

7 Support for unstructured Jata manipulation 
B Unrelated ^ A 

8 DegTee of learner co-toI 

9 Ability to adjmt to individual learner needs 

10 Ea*c of use 

C Communuiitutnt related * 

11 Amount of sensory .**pacj^ 
12\ Amount of emotionaMmpact 
13*" Degree of learner tct ioack 

14 Abilit) to acces< dat: or concepts previously learned 
D Economic*- 

15 Lowc6st per data iter orcopcepi 

16 Decentralize J availab litv 

f • 
' Figure 3 



Figure 4 hows the average of the professors 1 
ratings: one (1) being most favorable, and ten 
(10) being least favorable. The results inost ger- 
mane to this audience _are those listed under the 
heading ' Computer , and this discussion is limited 
to that group. To summarize and analyze'the data, 
we shall consider a score of three or less as 
being positive for effective utilization, a score 
of eight or more as negative, and four through * 
seven as neutral. The results of this analytical* 
7 format are set forth below with neutral items not 
I" listed. Under tutorial positive there are ojily 
^^.two items: the degree of learner feedback and 
decentralized availability. Under negative , 
however, there were eight: ability to telescope 
time, provision of rich environment, ability to 
provide Ill-structured "material quickly, flexi- 
bility for adding new material quickly, support 
for the learners struc^re^i and clerical tasks, 
support for unstrueturealdata manipulation, 
amount of sensory impaccp^and amount of emotional 
impact. \ 

Drill and practice found five positive items. 
They were, ability to telescope time, support for 
the learner's structured and clerical tasks, 
degree of learner control, degree of learner feed- 
back, and decentralized availability. Under- 
drlll and practice negative there were also five 
items. These were /.provisions for rich environ- 
ment, flexibility for adding new material quickly, 
ability to provide ill-structured material, amount 
of sensory impact, ,and amount of emotional impact. 

As we moved into problem solving , there were 
eight positive items: ability to telescope time, 
support for the learner's structured and clerical 
tasks, support for unstructured data manipulation 
degree of learner control, ability to adjust to 
individual needs, degree of learner feedback, 
ability to access data or concepts previously 
learned, decentralized availability; "While 
problem solving found only five negat ive ♦ 
features: flexibility for adding n£V materials 
quickly, ability to provide i 11-st rtfctWSl 
material and clerical tasks, amount of sensory 
impact, emotional impact, low cost for data items 
or content. 

There are six positive items under inquiry . 

Sere are provisions for rich environment, 
llity to provide ill-structured material, 
degree of 'learner control, ability to adjust to" 
individual learner needs, ability to access 
, data or concepts previously learned,, decen-* ^ 
tralized availability. Under negative there^are 
six^ items — ability to telescope tioe A ability to 
present structured materials,, flexibility for 
adding, new materials quickly, support for un- 
structured data manipulation, amount of emotional 
imprfet, low cost data items or concept. , 0 

As we move into the more sophisticated uses 
' or"" computers such as k 8imulation games, we find 
many more positive aspects as compared to the 
.» negative. Under simulation , we have eleven 

positive aspects. They are ability^to telescope 
^time, provisions for a rich environment, ability 
to provide ill-structured material, support for 
learner structured and clerical tasks, support 
for unstructured data manipulation, degree of 
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Figure A 



learner control, ability to adjust to individual 
learner needs, amount of sensory impact, ability 
to access data or concepts previously learned, 
and decentralized availability. The negative 
features of simulation are limited to two: flexi- 
bility for adding new material quickly and low 
cost for data item or concept. > 

Under simulation., amount of emotional impact 
was neutral, while under games it is classified 
as a positive aspect. The reverse is true for 
learner feedback and ability to access concepts, 
previously learned. They are both three 1 s in 
simulation, and (tnder galnes they are rated five. 

Rockart and Morton used the attribute data 
to' map the mechanisms' attributes on ^the learn- 
ing matrix. To carry out this mapping, the attri- 
butes were assigned into new categories with some 
attributes put' in more than one of the new group- 
ings. Figure 5 shows the author's opinion of how. 

' these new categories cover certain areas of the 

/learning matrix. 

In Area I and II, the C-E and FDBK represent 
cost effectiveness and feedback. In Area III, 
' L/CTL represents learner control and assistance, 
and MANIP represents data control and manipula- 
tion. In Area IV, EMUL stands for real world 
manipulation, and in Area V, ADAPT stands fpr 
adaptation. 

The next step was to look at the attribute 
ratings of each learning mechanism and draw spme 
conclusions. 

Xhe investigators* analysis of the data from 
the mapping is as follows:' 



Emphasizing one mechanism Is a mistake; we 
should maintain a smorgasbord of learning 
mechanisms . 



3^0 



On figure 57^reas I and V (cost effective-* 
ness and adaptability), traditional learning 
mechanisms (books, program texts, lectures, 
etc.) appear best suited and should not be 
computerized except for remedial learning. 

3. .In area "II (feedback), because of decreasing 
computer casts we can expect computerized 

* practice to make major inroads on traditional 
pencil and paper methods. * 

4. In areas III and IV (learner control and,' 
assistance, real^world emulation, and data 
recall and manipulation) , most existing 
learning mechanisms are inadequate, .and we £a* 
expect to see tremendous**growth in^computer- 
ized simulation, games, inquiry and problem 

t 1 solving. ^ . 

After defining what they thought professors 
should be doing with computers, Rockart and 
Morton" surveyed Massachusetts higher education 
(1974) to see what was being done. This survey 
elicited the conclusion that in general computer 
power for teaching with and about computers has 
and will continue to grow*. In addition; they 
found that the growth pattern was 'quite similar 
to their normative model with most efforts in 
areas II and III, and the use of simulation, 
gaming* and inquiry less common. 

After examining the ^environmental conditions 
affecting higher education (attitude of society, 
economic conditions, funding agencies, student 
population, competition for students, and student 
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attitudes), they concluded society will (but not 
to the degree of the pas< decade) continue* to 
support higher education, student populations 
will grow, competitive outside forces in economics 
will move* us toward more uses of technology, and 
a no re/so phi stic a ted student body will be more 
receptive to the use of instructional technology. 



The analysis'of the internal constraints was 
not as positive. While the .administrators atti- 
tude may be favorable, the faculties attitudes 
will not have the same ppsitive impact. The 
averag£ faculty member will see many more reasons 
not t(fwork towards the introduction of instruc- 
tional technology than positive factors. 

The overall conclusions of . the Rockart, 
Morton report are, first, the change and improve- 
ment of inatructional technology will have a 
potential* impact on the way we conduct outselves 
in high education. 

The three major* influences appear 
to be computers (reduction of cost, 
minis and networks), television 
(voice interaction with. remote 
.audience) and libraries in their 
nonpaper form. • 

Second, before putting more money and effort 
into the utilization of technology, we need to 
better underat>and where and why to apply it. To 
underscore this statement, they set forth the 
following specifics: , - 

» 

We need a robust model of the learning 
proceaa. 

We need a, "smorgasbord" of learning 
mechanisms. 

Programmed inatructional type CAI haa had 
too much emphasis. 

The opportunities for compufera in 
high education lie in the "enrichment 
activities," 



In most cases we will be adding new 
learning mechanisms, not replacing 
traditional ones. 

0 

One case where replacement car^and 
should take place is computerized 
drill and practice replacing tra- 
ditional homework and /or written 
assignmeats. 

And, finally, the pace of implementation of 
CAl.will.be slow because 

the favorable forces are not nearly 
as powerful as the negative. 

In doing my analysis of. this report, it seems 
appropriate to start with the three"questions 
posed by the investigators and the answers they 
provided. At the time the questions were set 
forth, they indicated that only to the first one- 
Can CAI be cost effective?— was there an unambig- 
uous answer. They felt CAI could be cost 
effective in aome cases, and later conclude that 
drill and practice and simulation are # cost effec- 
tive but tutorial'is not except in unique situa- 
tions such as remedial learning. 

In trying to answer the other ^wo questions— 
In what waya will computers^af fcect higher educa- 
tion, and, How should a faculty member approach 
selection of CAI? they certainly made a major 
contribution toward an answer yith their scheme 
for placement of learning mechanisms in various 
atages of the learning process. But as we all 
« know, there are no simple solutions to complex 
* queations, -They did take a major step toward 
'providing us with toola and background to '„ 
develop plans for selection and utilization of 
computer assisted instruction but, at least in my 
jufigment, they may not be totally correct. 
' Rather than deal with whether or not they provided 
definitive answera to tbeae rather global 
queati6nS, I prefer to analyze their apccific 
overall concluaions, * • , 

Let me start with thoae specific points that 
I agree with almost in total: technology will 
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continue to have an impact on instruction in 
higher education, the adaptation pace will be 
»lou» because of resistance at the faculty 
level, we need soRe theoretical node Is 01 
learning upon which to base our adaptati on M 
we vi 11 never have a single or even Wafiv 
learning mechanisms. 

1 agree about 75% that the best oppor- 
tunities lie in the enrichment categories, that 
«w A drill and practice can conceivably replace 
traditional written homework assignments, and 
I i ; rogra»u?ed instruction approach to CAI has 
»et.i its day. 

"y basic disagreements lie in two ateas, 
and oot^h require some crystal ball gazing. One, 
1 do not see large computer networks such as 
proposed pyr the PLATO and others as being likely 

have long range success but necessary inter- 
reJiate step** . *"~It appears to me t that the develop- 
ments of intelligent terminals, micro processors, 
ind video disc storage are going to provide us 
with very sophisticated self-contained individual 
teaching stations that will avoid tho reliabil ity 
and storage problems of a centralized network. 

My second and more serious disagreement is 
»ith the learning t model and matrix proposed. * 
Although I concede if! is better and more opera- 
tional than anything else I have come across. 
The problem may be in what wc are trying to 
accomplish in higher edtKiation. Are we imposing 
rural school educational goals and procedures on 
students living in a highly sophisticated com- 
munication and information processing society'- 
So far, our utilization of TV and computers in 
instruction have been to put old wine in new 
bottles. 1 do not knov the answer, but maybe we 
need an educational "think tank." Just as the 
military has changed its goals and procedures in 
fighting a war, maybe some* of the things we have 
held Sacred in education can be bypassed, or at 
least learned 'in a much different way. 

for the interim in u'hich you and i will 
have to operate on a day-to-day basis, I plan 
to operate trom a model and matrix similar to 
what Rockart and Morton propose, and try to use 
a problem solving approach to tne selection of 
learning mechanises rather than become a pro- 
ponent of a single technology. 

BIBLIOGRAPHY 

Rockart, John Fralick and' Michael S. Scott 
tforton. The Carnegie Commission on Higher 
Education Report:. Computers and the 
Learning Process in Higher Education . 
New York.* McGraw-Hill, 1975. 



39? 



USING APL FOR DRILL & PRACTICE AND CAI 
Richard F. Conklin 
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ABSTRACT: The APL language is well-known for its problem-solving power in many applications, particu- 
larly education. It offers the student a "math laboratory", in which to experimentally define and check 
ouj various computer functions. Additionally, it provides the teacher with a tool for tailoring special 
drill & practice and computer-aided instruction routines to reinforce and test material covered in class. 
This paper describes a few of these techniques. 

On line number U the student response is compared 1 
with the true sum of X .and Y and if not equal (i) 
a branch is executed to the line labelled WRONG. 
This is the general form for a conditional branch 
APL: 



At the time this papel: was submitted for consid- 
eration, I had developed several APL "CAI" func- 
tions on an IBM System/370 time-sharing system 
(APL/CMS running under VM/370). Shortly after- 
wards, I joined IBM's 5100 Portable Computer 
marketing force and wa9 pleased to discover that 
* all of the routines could be easily* "dumped" on 
the 5100 and run with no modification. (There 
was one ... I replaced the word "percent" with 
"% h >„a special character not previously part of 
the APL keyboard.) I feel that the combination 
•of APL and a full-function desk top computer 
y#6ld a "teaching machine" with endless possibil- 
ities. 




IBM's Portable Computer 
A few simple APL techniques are essential to 
writing XAI-type functions. In this example, 
the built-in random number 
produce two numbers, X and 
is asked to add. 



generator is used to 
Y, which the student 
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we discover that the only way 
(-»yin lieu of an answer. 
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Recent enhancements in the language offer more 
possibilities for CAI. Student responses can be 
accepted as character input, and analyzed for typos, 
special commands or formats before converting the 
string to numeric for- grading. 

The following function allows * any APL expression 
to be used as a model for a drill & practice 
session. Each constant in the model equation be- 
comes an upper limit for a randomly-generated 
number. The word END is used to break the loop, 
and a score is printed. Some examples follow, and 
£he listing of the function flay be found at the 
end of this paper. 
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Still another technique for creating CAI drills 
involves "packaged" APL functions which require 
no programming knowledge of the teacher. One, 
called ENTER, asks for each of four key elements: 
the question, the correct answer, ji_correct 
answer message, and a hint (wrong answer message). 
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The format for performing a conditional branch 
in APL can be a bit cumbersome when used repeat- 
edly in a CAI or drill & practice routine. A 
better way is, to wjite a small "one-liner" func- 
tion which compares a student respbnse with a 
canned answer. Called CHECK, it can be used 
whenever student responses need to be evaluated. 
Shown bplow, it is used within function CAI3: 
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The APL variable, AEDS, is used to store t)ie drill- 
Any number of questions and answers can be entered, 
and a null (blank) line terminates the function. 

Before the first student takes the drill,, the 
teacher may choose to reset the scorekeeping 
function. SETUP AEDS does this. » 
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Finally, when the last student has taken the drill, 
the teacher displays the class statistics, using 
function SCORES: 
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' OF THE USER BY THE USER. . .FOR THE USER 

Robert L. DeMichiell 
Frank Greenwood 

United States Coast Guard Academy 



ABSTRACT There may have been several unspectacular successes associated with adminis- 
trative data processing. But-for every journalistic expose' of good news, there are 
multiple expose's of bad news The Purpose of this article is to show»that the applica- 
tion of the common techniques of users groups and liaison personnel can produce some 
tangible benefits, even for the environment with rather unique needs. * Us^er involvement , 
was sought and acquired as an information system was developed and implemented with 
limited personnel, equipment and time. 

The literature abounds with computer-assisted information systems designed for the 
user community. Many of these systems are precede^ by expressions of anticipation, such 
as • 

I sure hope that* computer group doesn't try to help me do my job - everything 
they've touched so far, they've messed up 

I don't like to read computer print-outs--especiaLly the fifth^carbon ceo'. 
Especially when they're always late. 

Jlow do' I # resist, the movement to automate? I've heard it costs moreand 
employs mo-re people. More people, more problems. ^ N'. 

/ 

I wonder what the boss thinks about information systems. 

Computers have had a bad press, and one reason is- that many projects fconcerned with tile 
development of computer-based information systems have failed Some have been 1 abandoned 
with incurred multi-million dollar costs, few benefits and a very hesitant and cautious 
future clientele. The reasons usually can be traced to one or more factors: the user 
does not know what he needs . the computer technician doe,s not know what the user nee»ds % . 
the communication gap between the two is a wide one, and, perhaps., neither reasonable-' 
expectations (costs, time lag) nor responsibilities on the part of both user and tech- , 
nician were clarified at tfie outset, ■» 

There have been unspectacular successes. Most of these have remained, as most good 
news does, in the background. Some computer industries and service bureaus still" make 
money and stilly obligate a large share of their resources to research. Some users have 
chosen the right tool for use by the right peddle in all the right ways. Certainly, 
some .historical knowledge about the successes and failures should shed light on the 
decisions of £oday and tomorrow. 

User~Involvement : Required 

The purpose of this paper is to present an example of a system of the user, by the, 
user and for the user. The pitfalls previously mentioned were* heeded and some positive 
actions were taken / to involve the administrative user, or manager, at an early stage oi 
development of his* information system (perhaps even computer-based). The dichotomy of 
the computing center's information systeln and the users of that system was avdided. 

The posture was one of establishing realistic goals, with progress reports instead* 
of expected completion dates, of promoting team effort for institutional objectives 
rather than parochial interests, of organizing for. institutional benefits rather than 
departmental empires, and of recognizing that people make systems work, not machines. 
People can make clerical systems^work where automated systems 'fait. £ven if the auto- 
mated system is. more appropriate. 

i ~B\it is this so unique? What conditions exist_at the educational institution 
depicted here, so as to permit a healthy working relationship among the, levels of manage 
ment, the leveJLs of systems development and the levels of data^processing -operations? , 
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What are some of these developed systems and how did they evolve? 
A Unique Setting With -Unique Systems 

The educational institution to be used as the' example here is. one of the federally- 
sponsored service academies, the .United States Coast Guard Academy inN» L ° nd ° n - Con- 
necticut The enrollment is undergraduate only, and numbers approximately 1100. There 
are nine'major fields of study with a heavy emphasis in the scientific/technical areas 
(mathematical, physical ,• ocean and engineering sciences) In addition to. the men "i- 
demands placed upon the Cadet Corps by the four-year curriculum, there are requirements 

in the military and extra-curricular spheres as well. Ph ysical fitness is encouraged 

by mandatory oarticipation in inter-collegiate and/or mtermural acniecic^r .discipline 
xs fostered by restrictions imposed throughout each day of 365 days each year. All 
cadets go to all classes; during the summer session, they are involved in prbgrams 
oriented to the Coast Guard service (naval operations, cruises, mission area ^programs 
throughout the United States, etc.) „„^Tl „ f rho 

The objectives of the institution are clearly defined. The self-development of the . 
cadet is primary and focuses on those particular traits and characteristics that merit 
che special trust of an officer's commission: a high sense of moral values, personal 
honor, integrity and a' sense of responsibility. The Academy wants to graduate young 
people who have the ability to think clearly, critically and analytically, coupled with 
the perseverance to work a oroblem through to its solution. In addition, the develop- 
mental process must include- -with equivalent priority-'specif ic maritime and military 
skills such as naval operations and tactics and leadership capabilities. The aspect ot ■ 
leadership and its relationship to administrative skills are important m view of the 
normal execution, of future roles in Che service, some of which require a high degree of 
endurance and resistance to stress (particularly in search and rescue operations) . , 

■'There is a five-year obligation in the Coast Guard for the cadets w&en they grad- 
uate. Approximately one-half of those who enter graduate. Approximately 80% "main in 
Che service beyond the five-year period. The faculty is composed of civilians, military 
offices "ho are permanently assigned to the Academy, and rotating military officer^ 
ml permanent faculty receive pay, get promoted and aspire "tenure in much the same 
way as most college faculty-do. The institution is governed by the n^tar" conCingenC. 

All of the above means thac there is a focus on several aspects of student develop- 
ment which is different from the -peer population. The faculty mix is . a unique fe ature , 
even with regard to the other academies. There is a sense of dedication Co the ^sel- 
ection and to the Coast Guard service-a factor which plays a large part m the purpose 

° f '^rSS.^nSSl'-.Sct^^fl-det development requires a strict. monitoring of 
all activities The program 'smarts a year, before the entering class arrives m July 
ml Admissions procedure! have* to select the most qualif " d H a PPi ic ^ s ce fo ^ a PP^ n s tme i s 
Several academic and non-academic factors must be considered and, since the process is 
a competitive one with neither geographical, quotas nor c f on g ressl ° n ^ n ^^ olv ^^ ' ^ 
quite complex Cadets receive pay and allowances to defray all expenses TuiCion and 
roll are free. Financial adminiscracion , cherefore, has requiremencs of accountability 
different from a civilian college. The issuance of uniforms, summer cruise budgecing, 
2„a "Ratability with government procurement policies , are examples of tftese dif fer- . 
ences Cadets lead, and are led, as part of the training program The brigade consists 
of four classes of cadets with several levels of responsibility; this occurs during the 
academic year as we 11, as during the sflmmer cruise programs. Ratings of cadets by "deta 
are collected on several performance criteria. Ratings by the officers corps on non- 
academic "actors are also collected. Conduct is monitored by the cadets, themselves and 
'Che faculcy (military and civilian) and as such, the demerit system requires daily 

aCC °There g are no computer-base'd programs "on- the- she If" for these specific applications. 
For example, in the admissions area, what college or university: 

, a. has to rank-order ics qualified applicants- scT that it can offer appointments- 

C ° 'b 6 'holdfa special board of 6fficers for each qualified applicanC (academically) , 
so as 'to include in the overall rank-ordering other non-academic attributes? 

I is accountable for such a selection process to .every taxpayer in Che U S ? 
' d collects extensive psychological and demographic data on all entering sfdents_ 

f ° r r is required co^ncScracfraCher defiled information on the* medical status 
' of each applicant throughout the qualifying process? , .. 

Similar examples in the other areas of concern could be ci*ted "correspond to the 
special demands placed upon cadets, and therefore, upon the support fam: the adminis- 
trative off^c^s in their decision-making and accountability roles. ^ ^ 
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A Viable Alternative Solution 

D 

The applicants have to be kept informed on their status (probable appointment or 
not) so that their possible option of attending CGA is kept alive. From an institu- 
tional viewpoint, the Academy wants the bestrqualified candidates to remain in the 
competition. The cadets have to be kept informed of their status throughout the four- 
year period on all educational and military requirements. 

The, Academy also wants to make sure that the requirements, and tasks are specified, 
then, performance can be evaluated according to some established standards A quick 
look at the uniqueness of the overall program suggests that the manual method of data 
gathering and information dissemination is not appropriate. How then, can the problems 
be identified and any appropria^ computer solutions be realized for such a given 
situation? • . 

Put the analysis and programing teams to work, the user might say. Design a data 
base and evaluate the outputs so that reports for all the administrative offices can 
be derived from centralized file structures. Establish the procedures for automation 
and document them according to standards, so that the next person who has my job can 
understand it. All- of these are reasonable solutions in our computerized society, even 
in spite of the fears and declarations of doom mentioned at the outset. The important, 
question .is: To whom are these questions addressed? More than likely the recipient is 
the computer/information group . , 

In this particular case, the group has been a rather modest staff of computer 
science faculty P unit-record personnel, and cadets. The equipment is second-generation 
batch and in the Vr£cess 0 f being updated. The high-level managers pledge support, and 
the users anticipate sdme involvejpent . The key^ issue was identified earlier ^as* user 
involvement* But how does one get the user involved? 

User Involvement: Sought 

The success of any information system development and implementation rests on the 
expectations, attitudes and performances of people. People provide organizational 
structures., establish the roles and responsibilities for everyone within those struc- 
tures and, therefore,, have control over the degree of involvement of each element. The 
computer people have to be involved because they push the buttons, initiate tne inter; 
views and document all that is said and done. But data are not information. Without 
information, there is no institution. Without the interviews and dialogue between the 
opposing camps (the users and the computer technicians), there is no coordination The 
necessary mediating environment (users groups in, this case) was created bj the college 
president tx> provide an open forum of discussion'^ of the issues by top-level, managers 
So the immediate image'* of computing activities was one of applicability of the present 
and projected resources to all .users. It was also obvious that the computing resources 
and the "information system" were to be as meaningful as they Wanted them to be In 
other words, it is their system- and' each academician ,» administrator or researched must 
be involved 'if they desire to. compete for services, Their outputs* or summary informa- 
tion reports; Will .depend on their inputs, or contributions of time and resources 

This Computing Center Advisory Board of top-level managers establishes the policies 
on computing activities, computer personnel 'bear the burden of completing the staff ■ 

'work necessary for the evaluation process and for the reporting of progress. The major- 
ity opinion has a focus, and the opportunity exists for the defended minority opinion 
The president' assesses the situations and acts on the documented issues. Another users 
group of middle managers also was formed to face and resolve the day-to-day processing 

* problems. The organizational alignment of the Computing Center, with such an arrange- 
ment as this, does not become the issue. User involvement is sought, and for those 
users who do their homework and are alert to the capabilities of automation , they can 

be rewarded. » ^ j 

A policy statement then was issued. from the president. This document removed some 
of the fuzziness from the objectives of the institution with regard to computer appli- 
cations. Long-range and short-term directions were stated. There was no guesswork 
concerning, the opinion , of t top-level management. f| 

The* systems were developed from the "bottom-up rather than the top-down . Une 
system at a time was analyzed for possible automation. The present resources had to. 
be efficient, because they were limited. The faculty in computer science became the 
development .team, because it was recognized by' the institution as professional growth 
The cadets helped 'in development, because it was done as computer laboratory work for 
regular courses fo* credit. All student participation was screened thoroughly so that 
the projects were necessary to the institution and appropriate learning experiences for 
the cadet This program certainly has been well received by the cadets , over the years . 

Ifi order to fopus even more £n the user- technician interface, computing development 
pereonnel were assigned to certain users. In this manner, the' "liaison" personnel 
could be knowledgeable abciut the real requirements and needs of the user with the added 
advantage that- each user would have, to learn something about data processing as it 



pertains to his/her jot* Thus, the realization of large amounts of expended time by 
both user and technician surfaced. • 

To suppose that such an environment was created and has existed for the past few 
years without its moments tf frustration, arguments and personality clashes would be 
quite idealistic and incorrect. However, some things were done right with the help of 
those who failed in the past. Favorable results can result from unfavorable odds 
There are tradeoffs, as long as one recognizes them, i 

a. The payoff is not immediate; one has to wait perhaps years to *achieve^the 
defined reasonable expectations. \ 

b. It costs^ime and money to automate. 

c. It requires frequent monitoring; it may detract from other operational commit- 
ments. 

d. Students graduate; it requires detailed documentation. 

e. Faculty applicants are limited; not all faculty are interested in combining 
computer science instruction with practicum. 

Results and Conclusions 

Approximately three hundred computer programs, most of which are ^quite long, wer? 
written to place "on-line" the systems for the registrar, admissions, commandant of. 
cadets (cadet brigade matters), comptroller and other administrative elements in direct 
support of cadet activities. The unique requirements for each of these elements, as 
described in an earlier section, coupled with the fact that military officers serve # 
four tours of duty in key positions in the, organization, have required a dependence on 
documentation and cooperation . m . 

# The cooperative aspect was given* impetus by high-level support. More important 
.than a' stated instututional policy, however, was the recognition of the efforts by the 
various staff elements. Several performance awards were delivered to personnel in the 
administrative office's as weil as the computer group. Realizable goals were formulated 
and the milestones were accentuated with tangible monetary rewards. 

The Admissions Office now can monitor over 10,000 inquiries for cadetship and 
keep track of the status of each of these young people throughout the forma l applica- 
tion process. The resultant appointee would have been screened quite thoroughly for 
his medical , academic and non-academic credentials so that he cttuld receive -fair treat- 
ment in competition for one of the 380 positions in thte entering class . , 

The cadets are scheduled and sectioned in a very constrained program, with ilC tle 
time available for any make-up .work (there is no summer academic program and two- thirds 
of the coursework is required of all cadets, regardless of major, field) . Grades are 
reported in timely fashion- They are in the mail within two weeks of the end of the 
term, the academic grade point averages ate important in other ways military perform- 
ance is meshed with academic performance to provide* information on the whole man for 
constant evaluation for -retention Programs have been written to search«the student ± 
files for -easels fo be evaluated. , J 

Cadet pay and accounts operate from a developed credit cafd system, where the 
paper transactions monitor all the debits and credits, and are reported: to the cadets 
on a monthly basis. The frequent leadership ratings by off icers and cadets on cadets 
are .automated. This data and other militaryperformance ratings are considered^ whert , 
brigade .and regimental positions are assigned. 
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ABSTRACT: A total of about U80 students in an introductory computer programming course were randomly , 
assigned to PLATO (one hour per week using PLATO CAI lessens to learn FORTRAN replaced an ordinary lecture) 
snd.nan-PUTO sections at ?:00 and 10:00 am. Results indicated that PUTO students Gould strongly recommend 
that their fellow students choose PLATO sections in the future, while students in the regular lectures 
were nexitrol. , There were no differences between groups on exam or-machine problem scores. There was an 
higher Jrop rate in the PLATO* sections, but this was quite possibly due to factors ether than the PLATO 
materials themselves.. r 



% " INTRODUCTION 

For the past three and ,one-half years the 
Department of Computer Science* at the^University 
of Illinois at Urbana-Champaign .has been working 
toward automating a fraction of its /teaching load 
(about 2,000 students per semester) in introductory 
computer programming courses, by using CAI materials 
bNi ever gelt, 19751. Although separate courses are 
taurht for -different groups of students (engineers* 
architects, business majqrs, afcrU social scientists,, 
for example), almost all students learn FOftTRAl^ / 
so CAI materials to teach FORTRAN could be 
beneficial to almost all student^. Ail of these 
courses are taught* in the same format, with two 
large lectures and one discussion section (15-?5 
students with a teaching assistant) per week. 
So, initially it'w&s decided ti replace one lecture 
per* week with one hour o'f instruction in FORTRAN 
(or related programming topics) using PLATO 
(Alpert and Bitzar, 1970) §rr extremely' flexible 
CAt system with graphics terminals." 

♦ * 

The overall' design of\ the PEAIP materials . 
was accomplished by the author, although most 
individual'lessons (units ofV material, each 
designed to take 25-50 minutes of student time 
t at the terminal) ywere initially written by graduate 
and^undergraduate students as course and \ 
independent study projects under the^ author's 
supervision, and later revised and improved by 
members of the staff (Montanelli,. 1975).' Thus, 
overall the lessons do not follow a particular 
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teaching method or style, but each covers its" 
assigned material in its own way. (An advantage 
of this strategy for lesson development is that 
various teaching methods are attempted, and 
students essentially choose the better lessons. 
On the other hand, an entire lesson might have 
to be rewritten, if students* disliked it or * 
> learned little from it.) The lessons include 

.displays of all types: simulations, graphs, 
diagrams, animations, interactive exercises, and 
text. The students interact with, the lessons, 
taking the material at their own pace, reviewing 

'Whenever 'necessary and are typically quizzed 
during the lesson s6 that they can assess^their 
level* of understanding. _ f * * t 

\ , v 

After several rounds of debugging* and % 
testing with individual st^ents, ( and after 
voluntary use by 10 student's' durfng the summer m 
of 197U (followed by more modifications), it vas^ 
felt that many of the lessons were ready for m 
actual classroom use that* fa^l* • Accordingly, 
one-half of the approximately 50 students in 
CS 103 (an introductory computer programming class 
for students, in the, social sciences) wei;e randomly* 
assigned to use PLATO to replace one, of their 
lectures. The major results X of this" experiment 
were that although students, enjoyed using*PLATO> 
there was some indication that they did not»learn< 
as much as the non- PLATO group. More specifically", 

^ the non-PJATO group\had higher means on all three 
exairys, although tfcere were no differences in scores 
on computer programming assignments* The 
multivariate test for* differences betw^n group 
means was not significant (F ^-1.5** with U and 39 4 
degrees of freedom) at the .05 level. However' 
sinde all the differences were in "the same 
direction, and since two of the univariate Fs were 
nearly significant, the' possibility does exist 

' that the PLATO lessons were less effective than 0 
the lectures. An additional finding was that there 
were no differences in drop rate between the two 

v groups. (For more details, see Montanelli, 1975). 



*00 



39 



•Two possible major reasons for the above 
result were obvious to those involved in the 
-ourse. First, FCS ( swappinr memory i for th*j 
PLATO system was at such a premium, during the 
S'Tj^ctcr thvt students could -only be Fjaannt^d 
access to their PLATO lessons at the assigned . 
tine eacu week. Thus one major advantage of ' j 
>'AI, the ability for students to work at their 
v"»wn tir.es and to review whenever necessary, was 
Lst. (3l6w students probably could not even 
at their own pace, because they only haa" the one 
hour period to finish. ) Secondly, many 'lessen 
inadequacies and errors were discovered. 
Apparently, a developer of CAI material can ■ *t 
useful feedback from students only if they are 
required to learn the material from the lessons 
thev are study inr. Otherwise, one netrer discovers 
lerson faults. ' % ' 

The first problem was essentially solved in 
January, 1 when the amount of ECS was doubled. 
Additionally, during the fall and between semesters, 
r rc lecr^n improvements were made. This extra 
pro Trunin in »• effort essentially destroyed all this 
•vsthor's n priori notions about how much time and 
effort would have/tb go into lesson 'development 
and improvement,/ before lessons would b-e in rood 
".nine for routi/e classroom use. * 

Tim ><:/ sprinr l Cf T~ , the system was ready . 
*r a Inr-** Zcalr test. Accordingly, the 9 
^Proximately r 00 students in CS 10S (the required ( 
introductory course for business majors' 1 were , < 
scheduled to use PLATO twice a week. One of 
these sessions was a SO minute period replacing <a 
lecture (as in CS 103). In the second session 
(kO minutes'), students wrote small FORTRAN programs 
using a specially designed, interactive compiler 
with excellent and extensive error diagnostics at • 
compile *and execution time (Davis, Tindall, and . 
Wilcox, 197S). T^qsje programming sessions 
replaced some of ^he time students had previously . 
^pent doin^ computer 'programs in batch mode on 
an IPM Y>0, in the pre-PLATO version of. CS, 10S. 

Unfortunately, the additional* ECS which 
was to* be installed between semesters, arrrived 

• late. Tt was installed just before the semester 
bef-tan and hardware problems caused PIJVTO to be up- v 
arfd' down like a yo-yo during the- first 10-12: , » 

f days of the semester. The result of this profetem 
was 600 irate students, many of" whom were unable^ 
to successfully complete a single session^ on t 
PLATO in the first two weeks, even though" they k 
were scheduled for four sessions, and many* of the 
students attempted several makeups. ^ # , 

Although there was an unusually hifth' 
,percentatffe of drops during the first weeks of the * 
. semester, by the end there was evidence that the (h ' 
remain inp students were satiqjfifcd with ?LAT0 * ' 
f'hi of those completing a survey strongly 
recommended thtft a friend take a PIATO's-eotiorl^ 
whilt only recommended avoiding PLATO. • 
Steinberg, l^L' JThUS it was decided' to attempt »' 
to assess student learning by administering a k 
final exa?a which was constructed as a parallel 
form to the one used during the previous ceraester's 
CS 105* class* The exam, was constructed' by making 
minor changes (but in every part of every problem) 
in the old exam, such as .changing constants,' 
'variable names, programming problems to similar 



ones (e.tfi^ finding the minimum instead of the 
maximum), etc. 'It was felt that students would 
not have any advantage over 'the previous semester's 
non- PLATO £3 10V '.students for several reasons; 
O no one in the Computer Science' Department had ^ 
ever (to this author's fcnowi^dge) constructed a 
paralleWorm of/ an old final exam, for use in .a 
current course; o) final exams are not returned, 
and the previous semester's exams were safely 
stored BMntfftc) 'only the three professors 'involved 
m the course knew of these plans; and d) virtually 
every answer was different from the Earlier exam. 
The final exam results showed ho large or 
statistically significant, differences between 
^3 10 r > student's final exam, scores for the two 
semesters, an indication that the problems with* 
PLATO in CS 103 the previous semester had been 
overcome- However, a firm conclusion £ould not be 
drawn from these results because students were not 
t randomly assigned, some of the processors in.'CS 105 
were different from the.previous semester, and 
informatiun, on the f inal 'exam could haveTLeaked * 

, uUt. * • * ' 
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PROCEDURE 



In order to allow for testing same hypotheses 
about the use of PLATO in bur introductory computer 
scierfee^courses/ a contrpllelj experiment was 
desirned fir CS.-105, for fall, I91 r j. Five lecture 
sections were offered, with foUg** f* them ^ ' ^ 
arranred in*the following way. professor A taught *« 
PLATO," section (one'hour 'pn PfcATQ replacing one * . 
lecture) at 9;00 am, and a non-PLATp section, (two 
lectures, no access to PLATQ) at 10:00 am. 
Professor, '# taught, a non-PIATO section 'at 9:00 'am i 
and a PlAW secU'on/^t'lOrOO, . Professor (V who * 
"was in charge; of the course, taugttt & Kfth * * 
(PLATO) sectipn in /the afternoon, but- i*t was not % 
involved^in the experiment. ■ *lt should be npjbed/ %% 
that this author di'd not teach -any sections, and* 
tirat neither professor A X\or B had eyef used PL#T0 
^before the semester. > An additional mihoV difference 
'between the two typ£s of sections 'was that the, 
PLATO students did their first two maqhin'e .problems 
using .online PLAT0,-F0RTRAN compilers ibstead; of. * 
the Ifiif ^0. ( \ ' * N c * * ' 4 ' 

' jefore'tbe sem^fiter Jbegan, students -1 registra- 
tions ftfor the five sections were equalised -{by; the • 
Computer- pr6^ram whicb make's up stUdentrscnedules) 2 
soAhat there-x^ere 1 equal numbersi of ^studenjs , in 
ea^qh- section./ then students in the'^OO andJL0:00'^ 
-•sections Wrrf- randomly reasjeigned to, either* a PLATO 
.or nbn;PLAT07section.. v Stu/*eh€s ver<; kept separate ' 
]>y using tKe following mechfeiism^.^ ' 1^ 'Students 
were not/allowed to, <ransf«r sections, unless it * ; 
Vcouia w done-without affecting the experinjent. 
*For e«awple, a s^;dent could not sta^ at the saih'e 
iWp^ahd change sections. If a student wanted to f ' 
change from 9:00, to. £0:00 (or vice-ve^rsa), he/she 
had to keep the same type of section (PL^TO.or* non^ 
• PI4TO). , If a student wanted to switch fr^m the' * % 
' afternoon pctioq to a morning section, he/she was * 
randomly *assigned»to a PLATO or non-PLAJO section.;" 
^gfidehtis- were^ot ailewed to transfer* %o the^after-' 
no£n section/ Any student who » felt she/lie could not 
abide £it|fcbese n^les .was sent to the author who 
attempted to convince her/him\of the value of 
educational experiments and Vf PLATO (Thei*e were , 
» about ten such students*, and. most .wanted out of 
PLATO, presumably due to having heard about 
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the, problems from the previous semester). The result 
of these' discussions was that two students -who - 
protested violently against PLATO and machines in 
general were -allowed to transfer out c of PLATO 
Sections^ 2>) * Students in non-PLATO sections 
were not given access to PLATO, as a student * 
record with associated name and bode had to be 
created for each PIATO student ^fefcd this was not 
done for noh-PIAJO studantsj 3) * Individual 
attendance was taken in the lectures intended for 
non-PLATO students only, insuring that no. PLATO 
students could enter. In order to assess the 
effect of the&e precautions, students were asked ~ 
(via a questionnaire given to all students 
immediately after completing their CS Kfi final 
^exar^ if they had looked -at materials for the 
other p;roup*(they were assured that there would be 
no p#najty\ A few non-PLATO students had seen 
seme of .the PIATO materials through friends or 
through having access through other courses, m and 
a few PLATO students attended lectures, either 
throuf# using ti^ name of a friend who was not • 
^ttendinr or through slipupp in- our records. It 
was felt that none *>f these minor disturbances' 
would ha -e any major effect on results. 

9 

Th>j three hypotheses of this study were: 
1. PLATO students would enjoy the course more, and 
.^i/e it a stronger, recommendation to their 
£rierv1s v , - 

: . ?LAT r and non-PLATO students would perform t 
equally well OQ^^ams homeworks in the \ 



course. 

The drop rate's in the two types- 'Of sections 
would be similar. \ 



.III. 



HSSOLTS' 



^In answer to the # . quest ion Cfrcm the . 
questionnaire administered with the final -exam) : 
'If a friend were takiijg CS 105 next 'sprin&iand v \ 
PLATO and non-PLATO sections were offered, what 
voulij you recommend he take?' PLATO students 
strongly recosunended PLATO (112 circled 
'definitely PLATO', 88 'PLATO if convenient', ' - 
U; had 'no recommendation', 15 "said 'lecture if ' 
con/cnieht', and ?1 said .'definitely lecture 1 . *0n 
the other hand", non-PLATO students were neutral 
(their responses, in order, were 29, 22, 91, §6, 
_lo^ r; i>r^e>en showed, a slight preference^ for ^LATOJ 

* • In order to compare learning across groups, 
a 2x2 univfljri/ite ,anaiysl$ of variance "was computed 
for eacli exam -and for total 'points on computer . V 
' programs-. No significant 'differences were found, 
,afcb\ means were^nearly identical fd&the various- 
groups (Table 1). * 0 * , .-^ 



j m vTjje third liypothesis. concerning, droj> rates. 
w\g'- rejected, howeve^ -Pro^es ¥ soxuA hjajVl9 " 
drops friai his PWlto, section ,^snd only^ (Vft from 
'hon-*eLAT6.'* Prcffesrsdr 'B had 28 (2%) droftU**om I 
PLATO, artdv#V(l'i<"£) fror?t,non-PLAT£>. *" . 
Z* ... .{ ' " * * . 



. . Table 1 
3 Average Scores on Exams 
and Machine Problems 



(a) Machine" Problems 




PLATO' nofi-PLATO 
1*B * 1^2 * 
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IV. discuss-ion , : 



Students in the PLATO groups- would strongly 
recommend that their friends choose PLATO sections, 
thus confirming the first hypothesis. Even if the 
* extra,' 25 drops in the PLATO sections were strongly 
negative, they would have a small effect on the 

•totals of 200 PLATO student's recommending PLATO, 
and only 36 of^thera recommending lectures. It 
should be remarked that when the PLATO students 
were asked to indicate -what tbey thought were the 

iworst features of PLATO, 78 checked 'The distance 
to CERL* (Unfortunately the terminals are located 
on the north edge of campus in CERL, about a ^jnile 

*from most commerce courses.), while 37 checked 
'Lack of human contact*, and 31 checked 'PLATO « 
going,* down 1 y the next ^two most frequently checked * * 

r responses. Thus the major problem was unfortunately 

*out of -our control. 

■ * * 
* *. '•. ■ ' * 

\ The 'second hypothesis was. not rejected. The 

• nearly : identical .,s.oores on exams and machine problems 

Tablfr-I are evidence of tnact A .without reference 
to statistics.-v There is>*no reason 'to suspect that 
the PLfiSP drops- were pOor-studentsV* However, if the 
dropped F^ATO students were oelow averajg^, ^they 
could not have *had a large enougtuef feet on the ■ 
results to alter, the obvious conciUsioKv # This * 
result is" cerialnly in agreement with tco)& studies 
of the effects of 'CA-K>. In fact, when JamYoimj., 
Suppes , and -Wells ( 197 1 * surveyed ' ttfe e f f i c t i ven'cs s , 
of alternative instruct ional^media, they plated: ^ 

'/■.., the* equal-effec&Veness conclusion seepte to be 
■broadly correct for rwst'j&temate m'c^h'^ds ot 

♦ instruction at; the coll?ge" lwej. v- 

and, Suggested studying, costs of Various raetHods'.p.f , 

deliver^^^towever, a major advantage \q£ 'CAT is that 
r once used, it* is not .set in ' stone like a' textbook 

or movie.. As. a. result, of this ^experiment, *the two \- 
'lessons- whicjh students liked the^east are being re- . 

written- from soratch. Secondly, « qui*? system^ has 



been begun. When completed, it will present a quiz 
to each student at th\ completion of §Acn lesson. 
The qui229s are not written by The authors of the 
lessons, and in fact quiz authors are discouraged 
from looking ajt the lessons. However, the quizzes 
are written fron the same objectives that were 
used to write the lessons. The rcsultinr quiz 
scores will not only tell the students hov well 
they understand the material which the lesson is 
supposed to cover/, but will tell instructors and 
lesson authors how well the lesson is working. 
Thus, continual improvement is possible, and perhaps 
eventually CAI materials wiH»be B as .good as the best 
lecturer, and therefore better than many. 

On the other hand, the hypothesis about equal 
drop rates was rejected. This was a surprising 



result, espec 
year earlier 
differences. 



elective c^ur 



ally when the smaller experiment a 
under worse conditions) showed no 
However, the earlier course may have 



been a srecia. case. It was a relatively small, 



e with mainly juniors and seniors in 



(at 



nsyrholO'V an 1 similar fields. These students were 
more involved and interested in the experiment ' 
the author wal teaching the course}, and 'they may 
have stayed for that reason. On the other hand, 
CS '105 is a reqtired course for freshmen in the I 
college of concirce, and the students were I 
presumably lessn interested in long term educational 
goals ('for then* elves as well as for 'the PLAIP 
materials^. ^if(|L*ever, although this drop^jrate was 
.disturbing, «P$re were a few, likely reasons Tor 
it, all of which could be fixed. For one thing, 
the first thrfee -weeks were confusing for the 
students because they had pre-enrolled in a course > 
which they expjected would consist of two lectures 
and a discussion each week. Instead, three-fifths 
of them had a lecture cancelled and"had to sign up 
•for a PLNib section instead. These sections caused 
a lot of trouble, as some were scheduled for week- 
ends, anf many students complained that they were 
unable to meet any of the remaining available PLATO 
times. Although most of this confusion was 

• necessary due to the nature _of the experiment, in 
the future s.tudents will preregister for PLATO 
sections just as fo'r any other class. A second 
possible cause for tfce different drop rates was that 
for the first .few weeks, PLATO students were required 
to do. their programming problems in one of the* 
online, interactive compilers.- Although it was 
thought that this would be fun for the students, the 
compiler gave very poor response time because of the 
amount of processing going on to aheck for errors 
after*' each student keypress. Finally, drops might 
have been due in part to student dissatisfaction 
with the two poor lessons which were later rewritten. 
£tu(tents had not been systematically polled about 
the lessons before, and the relatively negative 
reaction to two of them was 'quite surprising. 

v ^ 'Another possible explanation for the higher 
'drop rate on PLATO, is that- some students (< 10$) 
are anti-machine an4 that CAI will always have this 
problem. The author -does not "Feel that the large 
differences found* he re could be attributed to this 
reasbn. However, this is being checked during the 
current semester, because the problems*mentioned in 
the preceding paragraph havebeeh fixea, and 

• although no exneriAent is being run during the 
current semester (all five sections of CS 105 are 
using -.PLATO), the current drog rate could be 



compared with past drop rates, in-order to see if 
thj PLATO drop rate <is as high as^was found here. 

t tf. SUMMARY " 

PLATO lessons can be used to replace one 
lecture a week in an introductory computer 
programming course. Students learn as much and 
prefer PLATO to lar^e lecture sections. The 
remaining problems are: 1) Is there a higher 
drop rate on PLATO? and 2) . Can instruction be 
improved through continued development of the 
CAI materials? 
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1 . introduction 

One o.f the challenging fields of computer science 
is the computer graphics field which, because of its 
relatively high cost, has not been used extensively 
for educational purposes. Recent hardware develop- 
ments |n the graphics technology and price break- 
throughs In digital equipment £re beginning to* ' 
influence the educational uses of computer graphics. 
If **a picture is worth a thousand words" and ifi the 
cost is not at this ratio, one can provide the, 
student, not necessarily of computer sciences, rfithj 
the possibility of a 'continuous inter-action ir 
which the student can see the results of ^his decision 
and thus allows him to experiment and practice with 
ideas not completely understood yet. ' 

This paper presents a design for an interactive 
educational system incorporating the recent develop- 
ment of the video*-disc. 

2. Background 

Computer, graphics is^fr^fairly recent addition to 
computer- systems and an evpn more recent addition 
to *educat ional type systpms. Ten years ago the idea 4 
of a computer controH*^ interactive graphics system 
in education was a /evolutionary one. However, 
today with the existing progress in hardware and 
the continuing price break-through in computer 
♦systems one realize* that the idea has come a long 
way but it still has a long way to go. It appears 
at this time that computers will be as indispensable 
In education as they have been in practically every 
other field.* The typical computer educational system 
comprises of a display unit, local storage of sorts,, 
a controller for the display, a means of interaction 
with the system usually a keyboard, and an intelli- 
gent part which could be either a local processor 
or a time sharing* computer. ^ * i 

Different) sy$&ems approach the above from diverse 
points of "view. Jhe Plato terminal, for example, is 
comprised ot a plasma display unit with a computer, 
controlled iear projection microfisce unit. The 
terminal communicates typically over the telephone 
with. the computer. The T # iccit system, comprises of 
a small color television set modified; to display 
computer generated characters with high' resolution, 
plus a speV & typewriter keyboard.' Audio and video 
for the terminal Is generated by a local minicomputer. 

The typical proposed Video-disc player oriented 
system is composed of a. commercial ly available 
televrsion set (pKeferabJy a color one\, a video-disc 



flayer unit interfaced to a local processor and a 
means of interaction with* the system. The local 
processor approach is not an exclusive one, con- 
ceivably one coulcj go over the telephone. 



In order that 
be more clearly t 
in short the prir 

3. Principles of 



Ihe advantages of the Video D 
iderstood. the next section d 
jples of its operation. 

iperat ion 




The video-dis: is being developed presently 
at least half a jozen companies with another haff 1 
a dozen^ doing sojne work dn it. The major target 
marke£ being the home entertainment one. Their 
projected price, for the'fclayeryls less than $500 
and less than $\0 for a 30-60 minute disc. These 
prices«are wj*thi;n economic reach 'by, practically 
everyone owning a color television set and thus 
the market is a,, very wide one. Because of the above 
reason the educational applications (especially 
with digital interactive and storage capabilities) 
are sort of pushed down the stack. 

Conceptually, the players are split into two 
major categories: (a) Contact Video Disc systems, 
(b) Contactless Video Disc systems; for the passive 
i.e., narrative, lecturelike type of educational 
system both types are well suited. However, for 
the interactive type of -education the contact video- 
disc is fairly useless. This is because the contact 
type uses a stylus to track the disc and therefore 
wear is introduced like the conventional audio 
records, 

The contactless type of video-disc player, on 
the other hand, uses some type of light to track 
the disc, laser light in some, to conceivably white 
flood light toothers. At any rate, there is no 
physical contact with the disc and, therefore , x no 
wear. However, the biggest advantage is that fye 
can Introduce' now, very desirable features IjKe 
single framemovement at variable speed, freeze* 
frame, as well as slow motfon arid fast motion > 
both in forward or reverse, The "player delivers, 
a US-NTSC 525 line compatible color signal v^deo\ \ 
format modulated on a low rf carrier to* any stan^ 
dard television rcceiver% 



The contactless video-disc players are basically 
two different systems** "Firstly described Is the 
PM 1 1 ips-MCA system which is comprised of a low 
power laser light focused into varying sized oblong 
depressions. The light beam's reflected light Is 
lost because It is diffracted over angles 
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larger- than the rilcroscope objective \k capable 
of accepting. This type of modulation is detected 
by a photodiode and is electronically processed 
into sound and picture* .The second type is bejn§ 
developed by i/6 metrics. The -disc is basically a 
photograph of direct analog recording of the video 
signal on a track of varying width and transparency, 
omitting any carrier frequency. 

The basic advantages of the videordisc are sum- 
marized as follows: (a) High Information Density 
(b)~Random Accessibility (contactless type). 

ii. Description of Operation of the System 

This section describes the principles of 
operation for the prpposed video-disc based inter- 
active educational system* Two designs are pre- 
sented, one that assumes a number bf feature* not 
presently available and one that could be implemented 
ith the advertised (existing features.) 
The first type of design assumes certain features 
r jhtch although not ava-ilable toda ' on existing 
players are certainly within the reach of existing 
technology. One- can envision the video-disc being 
separated into two types of ••files 1 ' or "frames'*. 
One type for audio* and video type (TV) signals and 
t h e other for digital type data. With the above 
assumption, hot ap unreasonable one, the operation 
of the system follows: 

The digital information storage "frames" are 
'containing code, in ready to execute format, for the 
local processor preferably a microprocessor or a 
minicomputer. 'On command by thei system this code 
is read into the»1ocal storage, contrcf .U-theh 
passed by the local operating system to the program' 
just read in which in turn control's the following 
sequence of video frames according ..to the answers 
for given questions asked by the system (written on 
the TV screen,- or 1/0 device). When the section' of 
the code in the system has been executed it causes 
the video-disc player to position itself over the 
digitaUy encoded frame containing the^ext part of 
tfie control program or the previous part-depending 
on the validity of the returned answers. Njhe 
interaction could 'be either through.a keyboard or 
through a cursor or a "touch panel". 

Due to the built-in capability of \ht player of ^ 
fast forward, fast reverse and random access ib'Nity 
of the frames a student could start' at the beginning 
' or from a particular section of the programmed \ 
material. This process could be accomplished either 
by selecting the "frame" through a menu or by^ 
manually over/ing the system by selecting the corres> 
ponding frame through the player directly: The 
software structure required in order to accomplish 
the proposed method* is fairly straight forward. n 

5/ Block Design \ 
\ This section describes two possible configurations 
fbr the video-disc educatfona) system Incorpora Ing 
a Tpcal mini or micro. The basic configuration is 
presetted in figure i and consists of the video 
disc player and controller, the host computer, 
. local memory, a color monitor and a keyboard input- 
output device. 
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Figure 1 . Basic 1 System 

basic system could be expjanded t< 
man factor" orfented system with 



The 

"human factor" orfented sys 
the following capabilities. The exp 
presented in figure 2 and it, consist 
ing additions, a graphics controller 
memory, thus," enabling the ufc'er to p 

. generated displays (overlays') text d- , _— 

"drawing compositions and 1 n general lenhance the 
nan/machine communication. <A "toucfi panel" could 
also enhance the educational potential of such a 
system. f J* 
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Figure 2, System with graph'ics capability. . k 

6. An Alternate Design 

An alternate design that is viable with the 
existing form of the video-disc is presented in this 
section, i.e., no digital storage only TV audjo and 
k video information. 

a. Software Structure , ^The control program for 
each-part the programmed^materlal resides- 4n 
some mass storage-device i ,<e. % , floppy disc or 
cassptte. Resident tn Jthe memdfy there is a 
fable with the correspondence between frames ^ , 
being displayed and^control code, Assuming V 
that the local memory Canrfet contain the com-'^. 

. plete Control program some algorithm could be 
developed^ that could be used to load from the 
mass storage device the control code in conjunc- 
tion with the correspondence table and the 
answers given by the user. 

b. Hardware Structure . This section $hows the 1 
hardware configuration for a video-disc based 
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eduGAtiorial system incorporating only existing 
vid/o-disc features (as advertised) in conjunction 
witA a local processor, the video-disc player, a TV 
coldr monitor, a keyboard input-output device, and a 
total mass storage device. The loca,l storage could 
be/either a cassette systero-or a floppy disc system. 
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Figure 3. Alternate Block Design. 
Cone 1 us ions 



This -papter has presented possible ways of incor- 
porating a fairly new development^ the video-disc, 
in an educational environments The principles 

\ involved are that of the state of the art and the 
advantages are great both educationally and economi- 
cal lyr With announced prices of less than $500 ^ 
fc& the player for the home -entertainment qbdel 'one" 
cou\d expect a computer controlled version to be in 
othe market soon. The digital storage feature is 
such' aii important part to all ^ata processing 
people\sing- fixed data bases (let's not "forget 
that the\video-disc in its digital storage version 
KjTDjJiinVbut a giant ROM of 10*° bits) that is 
bolTrrtfto bVavailable soon. The announced price for 
the disc c*r\less than $10 which, if one keeps in 
mind that they last forever (almost), makes a very 
cost-ef fecti veVapproach to storage of fixed data « 
bases (or at lefcst ones that do not require constant 
update). Final ?V the system in its expanded form 
lets the student \user) aad the' computer operate 
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SIPS - A STATISTICAL INTERACTIVE PROGRAMMING SYSTEM 



Edwin 1^ Anderson 
School of Education, Oregon State University 



ABSTRACT: SIPS, an interactive command processing system, was developed at bregoh State University 
to provide interactive program library support for statistical instruction and for data analysis. The uses 
of the various subsystems of SIPS (REGRESS, ANOVA, MO^E CARLO, MANOVA, MULTIVARIATE, 
ENUMERATE) range from simple computations to the teaching of elementary methods of data exploration 
and model building in the style that is possible with interactive computing. This paper presents a brief % 
non-technical overview of SIPS. ' - 

V INTRODUCTION 

TW Statistical Interactive Programming System, 
(Sl\s) was developed for a timesharing environ- 
mental Oregon State University in a cooperative 
effort\on the part of the Department of Statistics 
and the\OSU Computer Center. SIPS was specifi- 
cally designed to provide* interactive program 
library stipport for statistics instruction. The 
development of the system started" \n 1969 and 
has been continually revised and added to during 
the past 6 years. 

During this time period, SIPS has been increas- 
ingly used by faculty members for statistical 
instruction in various disciplines. As more fac- 
ulty members have become acquainted with SIPS 
and its potential, the trend has been. towards 
using SIPS as a major tool. for data analysis of 
individual research projects. At this point in 
time, there arc as many calls per month for 
research purposes (1500) as f6r instructional* 
purposes (1500). Faculty members and grad- 
uate students have expressed satisfaction with 
the rapid interactive responsVtime arid the 
convenience and flexibility of the- sy seem.' In 
addition, the elimination of numerous and/or 
intermediate output has beetv ple,as^ing and less 
confusing tolthe majority of the users. As such, 
it has detracted from the use. of an excellent col- 
lection of conversational and'batch-mVdc single- 
purpose programs in the Computer Center 
Library. \ 
A short statement from the SIPS User's Wnual 
(1) is quoted to inform the reader *>f the value 
of an interactive system. ' \ 

Interactive use grants the computer user 
a unique frccdom--he need not completely 
specify the entire sequence of steps his 
analysis is to consist of; he may examine 



intermediate results, then decide to modify 
his future steps or his data. "To a statis- 
tician this freedom is especially important, 
for to truly understand a data collection* he 
must be permitted to examine it readily in 
a variety of ways. Often the exact steps 
his analysis should take cannot be predicted 
\in advance. In that case he may either 
demand excessive computations or leave 
some aspects of hjs problem unexamined. 

2. OSU COMPUTING ENVIRONMENT ■» , 

SIPS was developed under an.d operates most ef- 
fectively under the OS-3 (Oregon State Open Shop 
Operating System) system. Development of the 
OS-3 system was accomplished primarily by a 
group of undergraduate students during the mid 
and late bO's while working on a generalized com 
mand processing systems project* OS-3 runs on 1 
a" CDC 3300 computer equipped with executive » 
hardware and virtual memory .paging capability. 
The executive progra\n is written in the assem- 
bler and is therefore ttejLtQ the JCHC 3300 and 
not easily transportable\ 

Development of SIPS on th\oS-3 system has vir- 
tually stopped at this point because, computer 
center personnel arc now almost totally involved 
with. the new CYBER 70 - Mod^l 73 and jts 
KRONOS operating system. SPSS a^nd BMD are 
available on the CYBER but "not in an interactive 
mode. Consideration fs being givejli to a new and 
transportable system erf SIPS on abdicated mini 
computer or the CYBER. The .lattpr. would prob- 
ably begin by complementing SIPS through the 
development of a rudimentary executive to work 
with large storage requirements and the heavier j 
computing of regression and multivariate analy- 
sis. 
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Under OS-3, user programs (such as SIPS) are 
"allocated a maximum of b5, 000 24-bn words of 
memory and access^ to the central. processor in 
one hundred millisecond time slices. OS- 3, 
like other virtual memory time-sharing system*, 
employs demand-paging techniques to effectively 
utilize computer memory space. Demand-paging 
allows a portion of the user's program area to be 
absent from computer memory and, instead, 1 
stored on some external mass storage device. 
When the computer detects a reference to a non- 
resident area of the user's program an interrup- 
tion is generated to notify the operating system 
to transfer that section into computer memory 
for execution* Much of the SIPS internal design 
concepts, were employed to function in coopera- 
tion with the demanfd-paging algorithm. 




CDC 3300;Configur 
Core memory 

Tape drives (4) 



atioV\ 
98, 304 24 BTT words 
(1. 6 tocrosecpnd cycle timeV 
150 inches /Second 
(200,556/or 8f00 BITS/inch 



Disk drives (5) 
Mass storage 
disk file 



dens ity) 
8, 192, 000 character s /drive 
268, 435, 45?(> Characters 
(100 milliseconds max seek 
time) 

CR T displays^ 6) ZO^iine screen, 50 charac- 

* ters/line 
Remote termi- teletypes and Tektronix 
nals (1 50) graphics j 

CYBER Configuration 

Core memory , o5, 660 60-BIT words 

(1 microsecond cycle time) 
75 inches/second 
(200, 556, or 800 BITS/inch 

density) 1 
117, 000,000 characters/ 

drive 
teletypes (64) 



Tape drives (4) 



Disk drives (2) 

* * »» * • 
Remote termi- 
nals 



Each systerd has its own card reader , card punch 
and line-printer. Two X-Y plotters are shared 
via mag tape - CALCOMP and GERBER flatbed. 
A PDP-8 serves as a satellite to the CDC 3300. 
A PLATO terminal is available for demonstra- 
tions only. On the average there are 39, 346 jobs 
per^month on the 3300 and 6, 387 jobs per month 
on the CYBER. The average number of users at 
any one time is approximately 40. 

'3. USE OF SIPS 

She instructional use of SIPS has progressed 
from one class in statistical methods within the 
Statistics Department to every class (except 
Operations Research and Advanced, Mathematical 
Statistics^witfyin that department. Within many 
schools ot the university some use is made of 
SIPS-in an instructional mode. The use runs 
from a purely computational tool to the teaching 
o*f elementary methods of data exploration and 
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model building., .As such, it has taken over a 
-large part of the entire statistical computing load 
of the university. Within the School of Education, 
SIPS is used for several courses such as Educa- 
tional Measurement, Resda^ch Procedures, Ap- 
plied Statistical Design, Applied Statistical Pro- 
cedures, a&id Introductioif to Computers for 
■ Teachers. 

As more students have fc/ecorrre involved through 
instruction, faculty members have been exposed , 
to SIPS an^ its applications ir\ data analysis. Af- 
ter initial inVolvement with the system, faculty 
members havY been using SIPS more often' for 
their own personal use in analyzing data. *To as- 
sist faculty members in becoming familiar with 
the system, the Computer Center and the Depart-.* 
-ment of Statistics sponsor numerous workshops 
' and" short courses\ Within the School of Educa- 
tion, several faculty groups have become, familiar 
with SIPS and ^"potential t'hro,ugh*in-service „ 
meetings. Manuals haVe been developed to in- 
struct the uninformed bV interested parties. 

There is a great variety fin the level of statistical 
complexity at which SIPS iV applied by users. 
Since SIPS originated as a Xaching tool, it re- 
tains much of the character \f that origin. <AU 
use starts by learning to manage data (read data, 
modify data, enter data. etc. . . ). Learning 
. progresses through various levels of statistical 
training from graphical and arithmetic descrip- 
•tion'to simple testing of one and two variables, v 
and o'n to Ct>i-square, regression, and multi- 
variate analysis, depending on the course objec- 
tives. The level of knowledge of the course in- 
structor becomes an excpedingly important fac- 
tor^ in determining whet.her the interactive capa- 
bility is really used or SIPS is used only \s a 
computational device. 

those beginning to use SIPS &s £ research tool 
must also learn the rudimentary. elements of the 
system and^ata management techniques. Jn 
most instances, the interactive capabilities of 
SIPS will not be utilized to a great extent until 
the user becomes quite familiar with the system 
T and is encouraged to take-advantage of one or 
more of the major subsystems. 

. 4. GENERAL COMMAND FORMAT 

As a terminal-oriented, interactive command 
processing system designed to support instruc- 
tion ancf educational research, SIPS commands 
^are simple, brief, -and of a logical nature to the 
'user. The commands are in the- form ot a key- 
word and, If needed, parametric information to 
define specific variables, observations, or op- 
tional procedures. The keyword logically re- 
flects the function to be' performed. Abbrevia- 
tions may be used in some cases but are gener- 
ally-discouraged. Basically, the user enters a 
command to the. system through a terminal key- 
board (batch-processing is also available) and 
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receives statistical results or other information 
in response! Responses from the system ar*e 
normally bJief and highly readable. The length 
of the resp nse is dependent on the ^ype of an- 
alysis reqi isted. Extraneous and voluminous 
outputs arc usually not necessary nor desirable 
when outpu : is being produced at a terminal. 
However, he user may give all commands from 
a terminal and hav*e the responses printed on the 
line -printer. This procedure is effective in 
some instances but does* limit the interactive 
capability of SIPS. " ' / ' 

SIPS curren/tly offers over two hundred opera- 
tional commands to the user. The general 
jform of a command is sliown below. The com- 
/mand is in the form of a keyword which requests 
a specific 'function to>be performed. As indicated 
above, additional tnfonriation (e. g.' variables Jto 
be considered) is requincd with many commands, 
and optional features are\vailable for some. 
These take VHe f <jj[ rm °* a parameter string. 

J 4 KEYWORi 



There are a number systems available throng 
/ OS-3, bu^he most important for the SIPS useri 
are SIPS and EDIT. EDI?, the OS-3 text ediiojf 
is used to €ile new data, modify existing data, pr 
, replace old data. *Data may be entered for SJPS 
in free-form or formatted as desired. In the / 
•latter case, the appropriate format statement/ 
must be given when entering SIPS. It is also pos- 
sible to enter data directly to SIPS from a tenmi- 
i nal. This procedure should be used only if tHe 
number of variables and the number of observa- 
tions per. variable are. limited in size.' Gener- 
ally, it is mote efficient to create a data file in 
the EDIT mode and have the flata read directly 
into SIPS. 




or 

PARAMET 



STRING 



lists all observations for- 
all variables i\current 
data file 

requests several 
of central 'tendency 
variable 3 (arithm<:t 



easures 
r 




CENTRAL, 1,2,4 
CENTRAL, 1 to 5 



KEYWORD. 
Examples: 
' LIST 

GENTtfAL. I 



geometric, and ha; 
means/median; qui 
mid-range; maximum and 
minimum values) 
same as above for variables 
i, 2*and 4, 

same as above for variables 
• . ! fo 5 i% . _ 
CORRELATION, 1,4 Pearson product -moment 
correlation coefficient^be- 
tween variables 1 and 4 
CORRELATION, 1-4 same as above except gives 
* Pearson r for all {>airs of 
variables from 1 to 4 
requests scattergram for 
variables 2 and 7. Variable 
° 2 on horizontal axis versus 
the values of variable 7 on 
vertical axis, • 
) parameter string permits 
user^tQ define iower and 
uppe'r bounds for each vari- 
, able 

•control is transferred to the 
REGRESS subsystem with the 
first variable (5) identified 
as the dependent variable. 



SCATTER, 2,7 



SCATTER, 2, 7,( 



Ke ywords 
^ ABORTOFF 
APPEND 
AVERAGE 
CENTRAL 
COMMENT 

\ compress 
oovar; 

•DESCRIB! 

EJECT 
f EQUIP, 



REGRESS,*, 1-4 



5. SipS AND SUBSYSTEMS 
OS-3 is the control mode monitor for theCDC330Cl 

HQS 




A' BO RT ION 
|AUTOCORR , 

COEFVA R 
, COMPARE 
COMPUTE 
CORRELATION 
CROSSPROD 
DLC 

v DU RBIN-WA TSON 

ENUMERATE 
- ERASE 



EXIT 


FAULTS 


FORMAT 


\ FORM tN 


FORMOUT ' 


*FREQ 


FREQHIST j 


FTEST 


GEOMEAN 


GRANDMEAN 


HISTOGRAM 4 


IF 


JKSTRUCT 


IORANCE 


^KDLC 


KFORMAT 


KfORMIN 


■ • KFORMOUT- 


K RUS K A L-W A LLIS . 


• KURTOS1S 


LIST 


• LOG 


MANN-WHI TNEY 


MAX 


MEAN 


MEDIAN 


MIDRANCE- 


MIN - 


M ON Tt- CARLO 


MULTIVARIATE 


N , 


NAME* 


NAME LIST 


NFWS 


NMISSING 


NOFAULTS 


NOMINAL 


NORMA LPLOT 


NUMERIC 


ONEWAYAV < 


ORDER 


'OUT ) 


PAIREDT 


, POOLVAR ' 


RANGE 


RANK « 


RANKCORR" 


4 RCROSSPROB 


READ '* 


REGRESS 


REPLACE 


REWIND 


RMD 


. RSUMSQPS 


SAMPSIZE * 


SCATTER 


SERIAL 


SHIFT 


SIGNED RANK 


° SICNTEST 


SEE 


SET 


SKEWNESS 


SPACE 


STAND A RDIZE 


STATUS . 


S f TDERRM 


STDEV 


STOPLOG ' 


SUM 


SUMSQRS . 


f. 


TALLY 


-TIME 


TRAFFIC 


T-SQ . 


TSS , 


TSUM 


TTEST 1 


TTYOFF i„ 


\ 
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Jn addition to t 
are pre-progra 



TTYON j I UNEQUIP 

V / • VAR 

VARIANCE \ . I WILCOXON 
ZEROALIOW / ZERODELETE - 

PROTECT / * UN PROTECT t 

'keywords listed above, there 
med functions to compute square 
root, natural ajid common logs, anti-logs, , trig- 
onometric functions, absolute value s # and round- 
ing operations. 

• ♦ 
The SIPS user has access to six major subsys- 
tems described below. ^ 

REGS ESS. The REGRESS subsystem^ useS to 
^perform multiple regreis'ion analyses. Computa- 
tions in this subsystem/are centered around con- 
struction of a model--tiie least squares* approj/i- 
mation of the dependent variable by a linear func- 
tion of one or several independent variables. / 
Simple commands allc^v tjie user to add variables 
or drop variables from the\nodel and at eacW 
stage to request infoXmatioh\bout the current 
model.' These. commands vnclKde requests for an 
analysis of variance table, the rVaultiple correla- 
tion coefficient, the partVal correlation matrix, 
residuals, t-valucs and other appropriate data for 
model building, h is through th\ us\ of these 
commands that the fulL intera ct in g potential of 
^SIPS is^ realized. Most .of the' regular SIPS com- 
mands, as listed above, are also avaflab\e to the 
-user in the REGRESS and other subsystem^. In 
addition, each subsystem 'has it^ own set 
unique commands. * * \ 

In using REGRESS, the ability to routinely ex- 
amine residuals/contributed much to the func- 
tional ^uidanpe of variable selection and to use- 
ful consideration of model adequacy. The user 
makes the final choice of the model based on the 
functional logic ofthe included variables and the 
behavior of the 'model for reasonable ranges of 
combinations ofthe variables. 
1 



Keywords 

9 

ADD 

•ADDVAR 
AVTABLE 
BACKSTEP 
DEP * " 
, DROP 
DROPVAR 
END 



ESTIMATE 

INVERSE 

MODEL v 

NOMODEL 

NORMEQ 

PRECISION 

PREDICT 



R-SQ 
RCOEFSE 
' RESIDUAL 
W4ATRIX- 
STEPWISE* 
TRANSFORM « 
YHAT 



In addition, when parameter strings and optional 
features are added to these keywords, over 40 
commands are available under the REGRESS 
system. As an example, the keyword ADD may 
haye the following format: 

ADD, (LIST) ADD, (LIST), F ADD, ALL 

ADD, ALL, F ADD, BEST ADD, BEST, f ■ 

ADD, BEST, (LIST) ' ADD„BEST, (llST), F 

MULTIVARIATE . As a subsystem of SIPS. 
. MULTIVARIATE handles the computations of 
multivariate* analysis. Like REGRESS, this sys- 
tem allows interaction between computer and 



user at each step in the computation, and Che 
user may revise his approach to analysis at any 
time. Once again, t the user may call for any of 
the SIPS commands to assist in the ana,lysie. 
Since most techniques of multivariate analysis 
are based on computations involving the covari- 
ance or correlatiq'n structure of the datay the 
system first commutes and stores a complete co- 
variance matrix for the variables designated by 
the user. 4 



Keywords 

PRINCOMP 
CANCORR 
ROTATE 



- VECTOR 
AXIS 
END 



ANOVA . This subsystem provides SIPS users 
with a convenient and easy*method of obtaining 
specific analysis of variance tables. - The compu- 
tations are based on completely balanced factor- 
ial designs. i^his^ituationSs not a serious limi- 
tation because most familiar designs can be spe- 
cified* in. this wan Using ANOVA\cfcmmands one 
can combine several main effects ajnd interaction 
mean squares (and eheir corresponding degrees 
of freedom) to' yield ata analysis appropriate for, 
a\split plot design, a nested design or a\choice 
oftnahy other spetial deigns. Specific\nulti- 
► way\lassification means are available fi 
sihgleXcommand, * 4 

Keywords 
AVTAb\ 

EXCLUDE v 
POOL \ 



CLASSMEANS 
F 

RESET 



MA NOVA . The MANOVA subsystem may be 
thought of as an extension of the REGRESS sys- 
tem to the multivariate case. ' It is not currently 
operational at this date. When contrdl is trans-- 
fdrred to MANOVA, the first response is a print- 
ing ofthe residual surh-of-squares matrix of the 
dependent variables a*ter i-egressing-on the-q^ - 
independent variables. Keywords, such as 
START, ADJD and ROTAT^ are then suppliedby 
the user to examine the discriminant functions ^ 
and the linear combination of the dependent vari- 
ables which provides the greatest association 
with the independent variables. At each stage of- 
the analysis, the signifiqance ofthe model incre- 
ment" is tested a'nd statistics displayed. 

MONTE-CARLO. The MONTE-GARLO subsys^ 
tern is'designed to simulate repeated' sampling 
v from certain populations and to accumulate as 
SIPS variables the observations in the samples 
and/or designated statistics ofthe samples, The 
user need only specify the population from ^hich , 
he .wishes to sample, parameters of the.<ftstr ibu- 
t«>n, the'number 6f samples desired 1 and the 
-sampfe size. Having generated this data, the 
user may use-SIPS statistical information re- 
quests, or commands from other subsystems, 
to perform the computations to analyze the data 
and to gain insight into the behavior of the sam- 
pling distribution. Thus, --MONTE -CARLO is 
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used primarily as an instructional aid. 
Populations currently .available ' • 



BETA 

DISCRETE 

F 

INTECER 
POISSON 



Keywords 



GENERATE 
POP 
PRINT 



BINOMIAL 
ERLAND 

Cam ma 
necbinom1ai 

T 



INSTRUCT 

POPULATIONS 

STATISTICS 



JCHISQUARF 
EXP 

CEOMETRIC 

NORMAL 

UNIFORM 



KFFP 
***PRINT . 
SUBTRACT 



ENUMERATE . Th'e ENUMERATE subsystem 
provided the ability to do tabulations and com- 
pute thi Ci/f-square statistic. It is designed to 
handle/oniji discrete (counting or enumerative) 
variables ^fn niimerical or nominal form. Tabula- 
tion is possible for selected values only or by 
combining specified sets of values. Tabulations as 
percentages are also possible. Chi-square tests 
are possible for "goodness of fit" and tests of 
independence in two and three* dimensional arrays^ 

There are three stages to. the use of ENUMER- 
ATE. t • 

(1) I>ata value grouping 

(2) Tabulation \ " # 

(3) Summary information ' j 



Keywords 
CHISQUARF 
< PERCENTAGES 
£\ TABULATE 



\ 

\ 
\ 

COMBISF 
RESET \ 
END 



EXCLUDE 
SLICE 



PROGRAM AND DATA STRUCTURES 

SIPS consists of about 10/000 lines of machine 
language coding and over 20,000 tines of FOR- 
TRAN coding. -The archit(jc-ural design is.that , 
of a resident executive with support package and 
a group of over one hundred overlay, and* informa- 
tion files. The program coding levels are easily 
dichotomized as 'the resident 'section comprfses 
V all of the machine language coding while all the , 
overlay sections* are* coded in FORTRAN.* 

'The resident executive is the primary control 
section of^the SIPS system. It initializes the user 
memory area, performs input and output of all 
* data observations, ^handles all terminal commun- 
ications, performs command»and parameter* 
processing, and executes all non-ov6rlay 4 and 
non -major subsystem ao.mman^s. It is coded in 
re-entrant format which allow-s it to-be shared 
among many OS-3 users 'at once. In this way tbey 
demands uppn # the OS-S memory^resources fcy». % 
, SlPS'users are primarily for, humerical data 

' storage and 'functional overlays to service the, 
individual user 1 s*needs. • \ % 

Transient/outirtes (overlays) perform almost all 
major statistical and trans f6frriafcional .functions. 
These FORTRAN programs ar,<j stored, as OS-3 
core-image overlay files. t To perform'the above 
functions t# the overlay routines access the * a 
COMMON Storage 'area and commanicate ^ith 



the executive program for data observation 
access and input/output functions, 1 * 

Major subsystems are groups of programs which^ 
•perform interrelated processing. Most have a *■ 
matrix or data structure on which pertinent 
processing is done, AH of them have their own 
executive section and. common, 'storage ar ; ea, TJie 
major subsystem executive acts in cooperation 
with the SIPS main executive in the /unction of • 
command processing. The SIPS executive per- 
forms its' command processing functions normally 
for all command? excjSpt those relevant to the ^ 
major subsystem. These commands* are trans- 
JjeVred tCi the major subsystem executive for 
further processing. The execution of these com«» 
mands may involve only associated routines in 
>„the subsystem executive irea, or may require an 
overlay to be loadecVfrorA external mass storage. 
In this, manner, a comparatively small amoVint of 
fixed memory k spa w ce carf be used to .execute a\ 
large number of djffer,<{nt programs. %W hi I e tne 
transient overlay technique can-be thought «f as 
'iswapping" in programs for intlependentfexecu- 
tion, major subsystems can be considered as 
"mii^ 1 command processing systems which are 
swapped into memory in similar concept to the 
overlay programs. t Major subsystems allow for. 
rAore complex ^and flexible analysis of da^a. 

The rriajor data sections include (I) the data* ob- # 
solvations, (2) a COMM(5Narea for summary 
storage and communications, and (£)^a command 
table for command recognition, program initia-\^ 
„ tion, and parameter string process^ng f directives, 
As-any OS-3 program can at most yeference^wcu ^ 
banks of 32K words in each, the programs and 
summary information*are placed in one b'ank (low- 
er^ memory), and al] da^obser. vat ions a.re placed 
in the Qther bank Ripper m6moj;yJ. 1 ** 

The date. 'observations* are arranged so that all 
variables. for a single, observation are in consecu- 

, tive memory" locations, ''^ince all variables may. 
not have^the same numbdr* of ob^sojfvarions, pro- 
vision is'macje W allo*w ft for missing observations. 
4 Tne data observation area is used only for storing 

' the user's.cjAta. A *' 

v / . ' 

^Summary information for data variables, system 

status information, linkages between programs, 
variabljridentification, and user^enterfed "param*- 
* ter information are all available^irj. COMMON.. 
The summary injprmalion consists 1 of aimple 
statistical information for eac ^variable. The 
system status , information denotes such conditions 
as major subsystem operation, successful data # 
% *ntry, activity logging, "control of output inforrryi- 
« tiorf, and other pertinent system- conditions, * oTh'e* 
linkages betweenmajor suhsyrfj^ms are contained 
in COMMON tQ allbw t indirect access Vo^ the ex- # 
4 ecutfve. * Jh\a maintains the xie-entrat format-of 
the Executive program and also aUows the execu- 
tion to be changed without requiring re-creation * 
'of all application overlays. Data/variable 
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:• :- : ' 

• identifications, input /outp.ut buffer areas, and p 4 
parameter' string decoding -areas areafso found 

in the COMMON area. • . / * ' 

. The 1 Command table contains a sequence of com- 
mand definitions co,nsis?irig oi a keyword proto- 
type, status indicators, and functional informa- 
tion. The^ command table employs two separate^ 

* units: the internal table section and the externtn 

« table section.* The* ^internal table ii' coded, a s'paYt ' 
of the*StPS executive* program and* is partitioned* 
as' to character length of keyword and,, may con- 
tain commands with keywords from one to six- 
teen characters in length* By partitioning the 
commands in this manner,, only the subset of ' 
commands *vtfh*keyword length equal to tkat en- 
, fcerqd by the user need be searched. The external 

• table is initially store<^on a random access file 
^nd -consists of a directory and^a" list of command 
♦definitions. This list of commAnds^is divided in- 
to partitions of variable length arid command / r 
groups for <?ach major subsystem. ^During the t 
initialization of the SIPS system, theJirst group 

x in the external table is transferred by the random 
\tfile intp a memory storage area.v* The s$£ond * 
% £roup will not be accessed unless a major Vub*- 
system or a comrhind definition is^call/sc} for* by 
the user. / > * 

All of yie features of SIPS (in'ternal structural 
design, \ommands, interactive capabilities, sub- 
systems, ease of entering data and response time) 
.*all combine to make SIPS a^rcry useable and ef- 
ficient system. * * , 

7. SUMMARY f ° 

, Although SIPS fcegan as a tool to assist with sta- 
tistic&rfpstruction, the tren^J has be en '(or more 
users to interact with SIPS for the purpose otanm 
alyzing data. .Designed and developed by a j*int 
effort between the Computer Centef!atid the De- 
partment of Statistics «at Oregon State University, 
SIPS has continued to grow anjl become" 1 more , 
.sophisticated during the las} six years. .The in- 
ternal design and the program and data atruc- 
Wres were developed to use a limited amount of 

* fixed memory space; The shorthand precise 
commands, consisting of keywords and.parame- 
ter strings, were designed for the convenience 

of the user. The addition of major subsystems,- > 
such as REGRESS' has permitted the user to 

* truly interact wittt the computer and to control , 
the pattern or sequence pj the analysis of data, 
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Extep§ivS branching capabilities are included and can bejncorporated into a lesson 
vance, aip,*or lo repeat sections. These \branches can be optional or conditional (the result of - 
rect answer or'* result of "50*" correct Answers). .The lessons produced become object code which 



executes fasteffcnd with less core than some other systems. GNOSIS is written tn ALGOL for the DEC 
System-10 computer- by Jacob Palme of the- Research Institute of National Defense, Stockholm, Sweden, 
js available thtyjjrgh the DECUS Program Library. 



For the fast few years, some of the faculty 
members at Pima 'Community College have been using 
the computer as a tool .to teach various subjects f 
including Physics, Chemistry*, Sociology, Music, 
Math, Art, and Computer Science. The computer 
u^ed is a DEC Sjystem-10 which supports manytermi- 
nals on a time-shartng basis. 

*The Computer Science faculty members decided 
to augment the elassroom experience with student/ 
computer interacti6n. Because of the large num- 
ber of students and the number of different in- . 
,sfVuctors offering Introduction *to Computers, it 
was important to develop a delivery system to 
insure that a common set of objectives would * 
be learned by all students. The Computer Assis- 
ted Instruction approach provides standards foT> * 
a specific level of learning, without hindering 
the freedom of the Instructor's style of teach- 
ing in the classroom. It lends itself to the 
open-entry, open-exit concept of education. 
Students may proceed as .rapidly as desired, or 
they may repeat a set of objectives as often 
.as needed. It t also frees the instructors for 
.more individual ized teaching on a one-to-one 
% 'basis.' The CAI lessons are designed to rein- 
' force the subject after review of the text 
materials and* classnponj lectures, . 

^ A grant for a -pi lot project was gtv&i during 
the summer. o£ 1975 to Investigate the available 
CAI packages, select one of them, and implement 
several .lessons. The GNOSIS padkage was select^ 
ed because 'it met the intent of the project and 
required minimum software modification foKthe 
computer s'ystem. The lessons 'developed during 
the Summer Were tested and modified during the 
FalJ semester. This pilot project can sefte.as 
a model for future development of CAI lessons 
at Pima/Copim^jnJ^ Col lege. fc . . 

^ Preparing a lesson for CAI, using GNOSIS, N 
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involves several activities: 

I. , Planning the lesson, 

II. Writing the les'son using GNOSIS 
commands. ■ 

III. Directing the computer to generate 
and execute the 'lesson. 

K I. Planning the lesson : 

To plan a lesson, the instructor should sel 
ect the the topics to be covered, ancf ^organize 
them into a logical order. Usually the student 
has a reference text or has attended a lecture- 
on trie topics, So 'text type explanations are 
normally short summaries. This-, towever, can * 
v?ry by topic or by the emphasis the instructor * 
wishes, to* place upon it. A problem, c^n arise . 
in that tfie number of topics selected produces too 
jmuch lesson for a reasonable-time.. This can-be 
/resolved by eliminating some topics, or by split- 
ting the lesson into two lessons. It is import- 
ant to know how k the commands of the GNOSIS 
package work, as this wily affect the format of„ 
the lesson.* 

Planning the questions and answers to test , 
the students' mastery of a topic presents the 
greatest. Challenge. Subjective questions with a 
> relatively high number of "free form" answers are 
possible, 'but VERY DIFFICULT fo^execute. What is 
easy to compose on paper does not Tome out as 1t 
was planned when it is tested. The subject mas- 
ter may not be precise enough to limit the "free 
form" answers £6. the* program^can check them. 
Spelling, mathematics^and^language offer good 
possibilities foj^hls type ^"question and ■ 
answers\ (se6 exhibit #1) Objective questions 
with" multiple choice or true-false type answers 
are muchVasler to handle. Since the instructor ' 
controlsjthe format of all possible, answers, "those 
answers are alTthe program' must check, (exhibit #£) 

J- . i ■ 



eva-luatiQn of the answer provides- a supple- 
jry reinforcement for studeht motivation and 
ss. *he correct answer brings out a compli- 
altbws the- student to proceed or skip^ (at- 
the lffctructorKs Option) to another section. k A 
wrong ratyer causes a response pointing out the 
incorrectness, giving a word of encouragement, and 
returninVVie student to either the related text 
or questiVnVor another try. Responses vary and 
are part of GNOSIS. If the instructor wishes to 
put in additional comments, these are easy to 
include. A\neurwl answer (neither right nor 
wrong) also Van be>Jncluded<^with appropriate 
instructor ronarks/SU is important to alTow 
for the "unexpected" afiStfer, or else the program 
will give a "wrong" but just go on to the next 
section. These\inexpe'cted answers' will be listed 
-on the^teacher report, and may be useful in lesson 
modification. . x 

Branching is easy with GNOSIS. The instructor t 
can ask a question and, as a result of the stu- 
dertt '« answer: 



1. 



to 



Terminate -the lesson and tell the student 
read the textbook. 
' 2. Branch back to the beginning. 
7 3. Return to a previous text or question. 
4. Skip to a new section. . 

Thorough planning of the lesson; combineo* 
with a good understanding of the GNOSIS commands 
and how they operate, will lead to a good lesson 
Which is easy to write and run. 

II.' Writing the lesson using G NOSTS commands: 

Each GNOSIS command is preceded by a percent 
/Sign (X). The next % will act as the terminator 
for the -current command. 

OPTIONAU COMMANDS : ' 

tL^GUAGE — Allows English'or Swedish to be 
used and defaults to, English if omitted. ' 

UEACHER Produces.? report for the instruct- 
or which analyzes and summarizes the students' rer, 
•sponses. The name and address of the instructor 
are the only entries for the command. 

■ -* 

MAIN COMMANDS : (.see exhibit #3) t 

' ■ %TEXT — -One or more lines of text are writ- 
ten after this ^command. 4 

r » ' • * 

^QUESTION, — . One or more lines are entered 
,tb state the question to be answered by the stu- 
dent'. ? , f 

' XRIGHT — The correct answer is induced 
after this command. *. If more than one. answer 
is correct, i "'separate. %RIGHT command must be 
used for each correct answer the instructor > 
wilj accept. ; ■ 1 

> WRONG — The ^ith<5r writes th£ anticipated 
„ incorrect answers after' thte conmand. A sep*- 
Lrate %Wr6nG conmand must bemused for .each incor- 
rect answer that is expected. P$ 2WR0NG conmand 
followed by blanks- shoulcl be used for an/ unex-.', 




pected wrong answers in addition to the antici- 
pated ones stated in the previous 2WR0NG commands. 

tudent $n 

appropriate indication 
or wrong. If further coi 
(e\g. addition reinforceme 
should be included on the 
SRI&HT or 2WR0NG conmand. 
applv to several successi 
mand^L Jthe fcSAWE command 
the *3|AME conmanU, instead 
comments 

2END\- This command must end every N ^^sson. 
MODE COMMANDS : . t • x 

The following commands provide flexibility jn 
how the students' responses will be compared to . 
the expected right or wrong answers. This flexi- 
bility is provided in two- area?: 
• 

1. Words in the student "response may or may 
not have to be in the exact order of the answer.' 
(see exhibit #4) v * . - 1 " 



BORDER — After this command, student. answers 
wiU be accepted only if the words are in the 
same order as the expected pattern. 

3N00RDER — After this conmand, student 
s answers will be accepted even if the words are 
5 not in the same order as the expected patterti. 

y ?. Extra words in the student answer, which 
are no* found in the expected response, may bfe 
allowed or prohibited, (see exhibit #5) • 

2EXTRA — : Student answer will be accepted - 
even if' it contains extna words which are not 
part of the expected answer pattern. 

^NO EXTRA — Student answers will not be . 
allowed to contain any extra words which y are not 
part of- the answer pattern. * , * * 

The default combination is ^EXTRA a/|d XNOORDEtf. 
A mode command remains, in effect until it is 
changed. ^" 

BRANCHING COMMANDS :' 

To -adjust the lessen to the students achieve- 
ments, a student may 6e allowed to skip parts of 
the lesson, and another who needs remedial worjc 
' can branch to it-. J» 

A labeV is required to branch to a different 
point within the. lesson. Labels can be assigned 
to e.ither XTEXT/or ^QUESTION commands by includ- 
ing them 'immediately after the conmand and follow? 
ing the label W^ith a colon. Preassigned standard 
labels can also be used to: 

. 1. Repeat the last question. * ' v 

2. Go to the next text or question. . , 

f 3. £o to the beginning of the lesson.* , 

4*. Go to the end of the lesson. 





* XGOTO — The label given in this 4omma/d indi- 
cates wfiere to continue in the lessoa-Vronf this 
\poirft. tsee exhibit 16) ^ *> % 

i - * » ■ ' i m 

•\ -An e^lnple of -GNOSIS lesson incorporating ' u 
•th\previous*commands can be found in exhibit #7. 

HI. Nh'reotirig the computer to generate and execute 
tfte. leSsopy . * 

After the \lesson has been written On paper, it ■ 
can be converted i|jto compute r v rea$aM& form by * 
punching the lesson s statements on io punched 
cards, or typing o4r6ctly .into the computer using' 
an interactive -termina l\and ar$\texiu editor, avail- 
able on the sysjtem. The\lesson should be verified, 
o catch keypunching or typing errbrs'. 



fince the lesson i"s. stored on a secondary stor- 
age device, fol 1 owing steps are needed to trans-, 
form the lesson into executable form for the " 
( students (see exhibit #8) * , * „- ^ 

\ ' ' ' 

1. The GNOSIS program will read Jthe lesson,, . 
edit the lesson to' catch syntax errors, and if 
an£, print out appropriate error ^messages so- that 
the user can correctJtte- lesion. When, the lesson 
tloes not contain- synWxferrtfrs, GNOSIS generates 
ALGOL source program as output. 

2. Th§ ALGOL compiler is je-al ( led in to trans- 
* late the ALGOL source program into a machine lan- 
guage program. * 

3. The machine language program is loaded 

, into the memory of the computer and saved on disk ; 

• 

At thi£ point, the students can use a term- 
inal to v call for the lesson desired. y Thfe compu- 
ter follows the logic of the*lessb», prints the 
texts and-^questions, accepts answers, analyzes 
the answers and gtves appropriate right or wrong 
reinforcements, until the logical £nd of the 
lesson, or interrupted by^the student. 

Upon, completion, a teacher T&wjrt may be 
. printed showing the- number of questrtws^ num- - 
ber of right and wrong answers, a list oF^the_ 
unexpected answers, along with comments from* 
the student to t^e instructor. 

One approach to learning how to write a 
GNOSIS lesson is: 

whoVe lesson on paper> 




encourages motivation and learning. 

2. Immediate reinforcement for ritfht answer*/ 
and guidance to correct wrong responses help the ; 
student evaluate his performance* V • #-\ ' 

.;3. The^lessoh can be adjusted t\the stude 
to allow for individual diffef^eriqeS an^kconipe^ri 
ciss\* > , / 

At Pima Conrnunity'-Gol lege, 
*enceY?acu # lty is continuing, to jdi 
materials and to evaHiate Jtheir 
a Supplement to classroom itfstruc 1 
, school\ grows, and more faculty be 
x in CAI,\a worl^jhop to 'assist other^i 
bars toWplemenfc tj»ei r own^GNOSIS \esspn 
imVediatV goal of the Computer Science ~~ 





ughly 

„ , ions 

an'd answer^)*:^ 

4. Bersure all possible e answers are covered. 

5. Haver someone' else. asi. the lesson to catch 
any errors or ambiguous questions. 

After the first lesson is implemented, the* 
next will be much easier.' Knowledge of the' 
text,xguestion and answer patterns J help in | 
planning. and writing a second lesson. 

Advantage sT^f GNOSIS lessons,' as with other 
CAI methods can; bfe; ■. . J 

l\ The active participation of .the -student 
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. • EXHIBIT- il *T * ^ ... 

^GUEsrioN • r , * ■ " * ' , ' " - s ' / ' ' " 

WHICH DAYS COhK BCFttR^WEDttE$FiAY 1^ A UpEK? ' • * 

/:KIGHI MuttDAY TUESDAY* - * • • '"'/.■' 

:<Ur<QNO-iVONDAY • ' - « Bi * ,"«.•.' 

YOU UiJLY GAVE 'CtNE'flF T^'TUb . DAYS BEFOKE WEDNESDAY. ' ■ / , 

/ajkCito .Tuesday* [ * *~ . ? . • 

iCuJKDNU 1 ■ - * . , . • ' i * • 

A HINT J THERE ARE TWO DAYS' BEFORE .WEDNESDAY, ' . ■ • 

SM<QNG ; . # v * . # . 

k FURTHER HINT: ThX DAYS nFTER WEDNESDOY ARE THURSDAY FRIDAY m 
SATURDAY AUl* &UNDAY . " - * " % A * .* 

XliND 



which/j/ays com-: Sefore Wednesday, *n a w£ek? : . ' •' 

«*• '''tlUNIlfeY * TOSBAY '\ . • • - 

Wrunt! *' - ■• £ * 

. A 4 HINT,:. TH^rCE ARE TWO- DAY5T BEFORE WEDNESDAY. * ' 
Try* atfain, * " ■ 

WH^CH/BAYS CO ME BEFORE WEQUE&DAY Itf A UtEfcV " "■, 

MONDAY , ' *» J v 1 > ■** ' 

No! , ■ W • 

■ % YOU ONLY GAVE ONE OF % THE TWO- DAYS DEHORS WEDNESDAY ♦ * ; 
^ # Try fegain. > * '•' _ * ^ 

H WHICH XiAYS^COhE BEFOtffe. iJEDNi^SDAY *N A WEEK? t ; ". ' ' 

?T-HURSX«AY t t ' ' ■ • 

No i - , ... . * • 

A FURTHER HI NTT* THE "DAY'S .AFTER WEDNESDAY AKE THURSDAY FRIDAY' 

SATURDAY AND. SUNDAY . * . - * 

♦fry *3dam. * \ " * " s ^ 

WHICH D^YS COME BEFORE WEDNESDAY l\\ A WEEK? - 
•'MONDAY 'AND TUESDAY , * * 

Uollr there's hopoi ■ * 

The teacher U3* not nxp-eVtirts this £art of your anower: 
*1 AND 



EXHIBIT *f 2 • 

ALL RIGHT THEN - LET'S REVHW A LITTLE. 

THE Ff.Ai Jr.'ES OF A DIRECT ACCESS" FILE INCLUDE: 

A. THE ABILITY TO UO DIRECTLY •TO 1 HE RLCORD WANTED 

WITHOUT tiOINU IHROlf&lV THE ENTl'KL" Kla:» 
'b. SPElID IN F INDINtS AND UNITING A ^MALL AMOUNT 

Or" Kt CORDS IfcJ A LARGE FILc. 

C. THE ABILITY W K'uWRI TE AN UPDATED RECORD IN PLACE* 
RATHER THAN WRITING IT IN A NEW PLACE 

AND RLf.nVING THE OLD' RECOrtD. 

D. I HE POSSIBILITY orUSINb A FILE SCCWtN TIALLY .OR 
DIRECTLY f BY 0RGANI7ING IT UI'tH INDEXES. 

^o continue? push RETURN* 



VHICH Or THE ABOVE FEAj URES' IS DIFFERED < FROil 
THE FEATURES OF A TAPE FILE"' PLEASE ANSWER A* Bt Ct Pf 
E < ALL Of THE ABOVE) OR F (NONE OF THE ABOVE) . 

*\ * ' 

WronsH - 

NO I TOO ft AD t HUT HOW ABOUT A BETTER ONE? 
1 ry asiam. * 



WHICH OF THE ABOVE FEATURES IS DIFFERENT FRO11 

THE FEA.URES OF A TAPE FILE? PLEASE ANSWER »V* B* C, D> 

E < ALL OF THE ABOVE; OR F (NONE OF THE Aja)Vt>. 

rr 

Wron:t» \ 

coml on Notey 'Nave you really stubjed this chapter? 

REhcftnr.K' J# TAPC FILES ARE SEQUENTIAL f\Ut (IMS? BE USED 
SEflUEN~IALLr> " THIS MEANS NOTHING CAN. BE DciXFi 
WITH DIRECT ACCESS* THE WHOLE FILE MUST EE PROCESSED* 
AND IT IS DANGEROUS TO TRY s TO- UPDATE IN PLACE. 



WHK.H OF THE ABOVE FEATURES IS DIFFERENT ."ROM , 
THE FEATURES OF A TAPS FILE V PLEASE ANSWER Ar S» Ct D, 
E CALL OF "r,HE ABOVE) OR F (NONE OF THE ABOVE). 
?G 



No i 

COME ON, ANSWER ONE -OF THE LETTERS YOU ARE ASKED FOR. 
To conVinue push RETURN. 



WHICH. OF THE ABOVE FEATURES IS DIFFERENT FROM 
THE FEATURES OF A TAPE FILE? PLEASE- ANSu/HR A> S> Ct. Dr 
E i ALL OF THE ABOVE) OR F (NONE OF THE ABOVE) • 

. + E 

Very soori* 



\ 
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EXHIBIT *3 



XT^XT 

THi-KE. IS A RIVER 

IONS. THLRE IS ^ 

^QUESTION 

WHAT IS I HE NArtf. 



UlUCH bXUIDES THE* UNITED STATES 
STATE BY THE SAME NAME ♦ 



INTO EAST AND UEST SECT 



OF' THIS RIVER AND /OR STATE? 



ZKIGHT 

XrilUHT 
-XK/LHJ 

XUKUNG 
XUKUNG 
XURONG 
XEND ' 



MISSISSIPPI 
MI5ISS1F Kl 

mssjswi 

MISSX&SXPI 
COLORADO 
MtSSOUKl 
OHIO 



THERE IS A RIVER WHICH DIVIDES THE UNITED STAVES INTO EAST AND UEST SECT 
IONS • MERE IS A STATE BY THE SAME NAME. i 
To continue r-ush RETURN* i 



WHAT IS THE NAME OF THIS RIVER AND/OR STATE? 

COLORADO . ' % ' 

Uron^! / 

Try £*Uiin« ^ > w 

WHAT C-S THE NAhE OF THIS RIVER A^D/OR STATE? t 

No! 

Try 3^din« 1 ^ 

WHAT IS THE NAME OF THIS RIVER AND/OR* STATE? 
vtflSISSIPPI 

Now you're catching on! 
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INHIBIT f 4 

SUttE PHRASES MAKE SENSE IN ANY ORDER THE WORDS MAY BE ARRANGED 

2Qui:*rioN 1 , 

WHAT iS A COtfMDN ITALIAN DISH THAT MOST CHILDREN/ LOVE 

TiKltiHT SPAGHETTI AND MEATBALLS 

'/WRONG 

%TKX r " » 

0 MLR PHRASES NEED TO BE IN AN EXACT ORDER TO MAKE SENSE 
ZUUUSTXOM 

WHAT PHRASE IS OFTEN USED TO REFER TO JOVELY COMPLEXION 
ZGRHUK 

2RIC3HT PEACHES AND CREAM 

ZtfRONG 

5: END 



SOME PHRASES MAKE St'NSE TN Af^Y ORDER ThE WORDS MAY BE ARRANGED 
To continue push RETURN* 



* w'HAI IS A CQHMQN ITALIAN DISH THAT MOST CHILDREN. LOVE 
?ML"ATBALL?» AND SPAGHETTI 
Good for y.Ou! 



f . OTHER PHRASES NEED TG'.BE IN*AN EXACT ORDER tO MAKE SENSE 

To continue push RETURN. * * 

• • *. 

WHAT PhRASE IS OFTEN USED TO. REFER TO LOVELY COMPLEXION 
. ? CREAM AND FE.ACH&& 00 
No! 

Try 33^ m. 

, ' WHAT PhRASE IS OFTEN USED TO REFER TO » LOVELY COMPLEXION 1 

?i PEACHES AND CREAM * 
^ Now you're catching on'* 

The' teacher was not expecting this part of your answer: \ 

* • ' : » • v 
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EXHIBIT 5 5 

XTEXr / 
♦EXTRA WORDS ARE ALLOWED IN THE STUDENT ANSWERS. IN SOKE: CASES 
^QUESTION / . / 

IN WHAT CONTINENT DO WE LIVE? 
•'.EXTRA r * 

XRIlVir, NORTH AMcR'CA I ' 

XWRfJNO ' 

XTEXT ; \ g 

SOME miLSrihNS DO NOT ALLOW THE STUDENT TO'iWSE t-XTRA WORDS 

ZQIJF&TXIri j 

COtfPlETE THE FOLLOWING ADDRESS WITH TV FT NANE OF A STATE . 

i5io S\ ELH r TUCSON ? ' \ 

ZNOEXTRA \ 
%RIl>hT ARIZONA a \ 

ZWRONG . \ 

ZEND . \ \ 



• E>TRA WUVPS rth'E ALL U»0 IN THE STUPf-tH c AN:Uif-RG IN <V)M* CASE 
p fo rout u.uo :-uoh . r:ETU r <N, 



IN y-i.M CONTFNFN7 DO WF LWF. ? 
VfV| F-iCA- 

Wrort^ 1 ' 
Ttu o..^i.i. 

r;' UlAl CrSNTTN'EMT DO LIVF*' • ' i * 
-JU LIVE [fj w-'ltfTH Af« i.JCA . 
Nom voij'rc Cotchids on* 

The ti*^r:»»T w.i5 not o .fectj.ru* this r-^vt of vour ^nsucrJ 
wr LIVE I* • 



S&tfE QUESTIONS DO W3T AuLOW THE STUDENT TO USF L/TRA WORDS 
To core In -ue Fuoh RETURN. 

iCCW'LrT/ THF fO» LCWTNt. k ADn*£SS WITH THE Ni':Pe\* A feTATE *" 
xl'iOO t"LM v 7UC30Nf-t-- ' 

"If 1.5 iVV'ZGNA - " \ x 

Tr«j rirl^JLft. 

COAPLCrE THE FOLLOWING ADDRESS WITH THE NAME OF A stATE^ 

100 0 S. li.rt? TUCSON ? : 

"ARIZONA . 

UollV v there's hOJ*e! ' A \ ' 
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EXHIBIT 36 



'/.TLX'' I n \ : 

;.ou« <>t iU'i 

\< l u rt.ttffcjft ALLOWS 

rxoui uu:< 
\to»o l ki : 



?8 



Iv'ilnT NlJ?1r:-:^ rr>LLO«?S 6 7 
v 9 

No ! . 
Correct onnw^r ! 

WHAT NUMBER FOLLOWS 37 ^ 

?G . 

No' 

U'+*7 NUiinCR FOLLOWS A? 

No* worn' re wrona thi*. tirae." 
Try 3**£?tn» 



MAT NuMP"R FOLLOWS 6? 

?9 » 
Nidi (<uito. 
* Correct dii r »we a r! 

7 

Ui AT NUMBSK FOLI.OiJS 3? 

You're doing f int . 

To continue p»j«mi RETURN* 
I* „ • 



WHAT NUMBER FOLLOWS 101? 
vi 02 * 
EiCd'.tly riant! * 



GO 



H21 ' 



„ 9 ■ 

ERIC 



> 

EXHIBIT -J7 (Dage 1) 



, 1. A J 



! 



in; v ! c F'iifLir:oi »^ Oi 1 i/jl-h n : ( .if-n taia KROc:i:s:>fKi- is 
-u Mcac sou-oirtiA a:^ n-.-M .;i"H|: fc «n* c<vm; to 1 

IKO":l: -5 THIS DV« IC'.Vi TIL JlX Or i. 

ir *<k an riii^A^fi. ,rous .Vir :u hf i-ruf:: ci*iks imia* 

' <G«vE THE C*'f:MCi ilUMrt R >'uf". VU;^ *' tfS'.r.l>. ) 

Jl i.ri.iHINf ^'ffiiS- • K"U.riM> ill I RKii 
? RSruT'lWt U: r 0- :i"r..W.N!» l.'TLRL*,*' IN b'OhKj.'iu WITH HACHlhlS 
S TO IT- KL\fb*'H T Ai ENTS .i.*fl-l. J r HOLlEnUH CO*lE 

I REPE7 . i U'l USL Or DA TA AMU fV u .r. If* I I 3 

lofiT 4 * - 

;Vl'.»rfN r > C'.LRhS Th» iOf A PhTMAKt O'.WITAGF U : * rUUGHCfl fo&U DritA 

KROC'.v-Tifl. fr^rrui iti- irsr and tht.-jk kardlr* 

U-".-^r fJ W.i;\iV.V fcJTfl. r VMTi'/S 13 HOY. AM £$JMTi*(>S OF TKE 
I ; ,i:"iH0i- !u.<.l'l«.*Ci iSIiW UnTru 

;:t*A.\r. . - - 

U'. TLJ/ulG ..I.VIM.VCH f ALi'NTS WOULD PO". JE NECEfttAKf IF WRF -l#t <L 
HOT AT'OANT*. Vj TSr r'UNCKE. J CAf'fi tWTHOD i>" DuTA P/cGCr *8I N'3 . 
UHAT AS'L THt AIA'AN i AGES? 

YO'.A.fUST CHno'ic AN ANSWER' lr IS 3 uR 4 

;;o<:i ;7ion ujt ::jc: 

tlO* mANY RCwS 7 HERE ON rt STAND^R'J rV.iCMEU oAf'O v 

BRIGHT 1£ f 

zrieur ticlvt! 

-•.wmg ,s - 
CLOSi!? BUI THlNI^ or THE rows carefully and TJJY Mwltl 

NO * THAI X? MIL NtUibER 'COLlMfcS 

ZURfW;? „ . 

UhKH » : -0U JN 7HL CARD CAN I'C USED AS t-XTHER A, ZOi^ GK 0ifii7 COPc s 
BRIGHT 0 

'^i<1GH7 /ETvCJ - 
ThlNK OP THE ^ONES <i^»tl«.WU 0) AND- THE DIGITS, <0-:> , . 

uiOrsnoN 

what woui n r<r: roiiBTNFn »^n^ a o- 7.gne to cons7kuci the 

LE71ER *W fc IK ,'HL HOLI ER1TH CODING SCHEME f 
BRIGHT 6 , 

• YOU tURGOl 7HA7 THE S-Z GRHijP OF LcT'iFRS' STARTS WITH THE .0-2 
Tf<"3ic.AB Of 0-1 ZOKE/DlGTr COMBINATION \ 
XUMllG ' J 
REHrneER THA7 THE GROUP Ci LETTERS A-l HAS A KOLLIL'RITH 
l?-2GNCi J-K- HAS ArJ U-"/0\'Ei G-7 HAS A 0 ZONE 



EXHIBIT #7 (page*2) 

■* • % - 

• •I ; durst.* * a r * • 

Ml . 
... \ \ \ <]\vl . 

SI io,» 1 
.1 'JlVljillJ 

Iiif MiihiHUR IS l:bl"i%CSE-»nrii BY Hit 1 WONE ASH Trii: R-DXG1T 

•..:!»#•;! \ 

MJMjiK* * 

M.^ONi t H'f AT" ? . • ^ • 

j.j ; r ii r.ii ir,:.t i.imh rt a a group nr ci>lukns on v 

r.#. H KilCH r*» r ivLffci'i " Of»J '»rV.A 'Hf f. ? , 

/. i »i. 1 1 T . L I v . » 

:.> M r! ." ' . fM 

i 11 iO*-..lOI sS^ll Tff!V i v U'-Lii.. -tUT. YOUR AMbUr! X f i r .m. F TA3LR ' 

Ui i'L:is!»r-, ih/i! ■;• r &» rn?.\!i::i in ..i.'.ns tp kl.o'.*';; hata/ hnj 

iri'G liATn ib ?:k(il Lrl UI ' JT.Vf. lii-ANJ UL uK.RiriM WI.A! A*t THEY I f d' 
".tii , I [UN . . * 

H >i r iJER'..AKE TtleRL ,fc THE 'PUNCH rUKTIOfl Of 1 KL V/, THLUSN CARD' 

::,*i.a •• 

[ ,i j ( J[ . u r. Tu :- f.u^iN CAM HAS 32 r OS T » T0N3 IN hV.li ."iTuoH F.nl» 

if,-:, t ri: ttic v^-loll^m "Cr.o has, a uoiumg sciii:;n; <>f 6 kou.i flu 

» \AC7!R .UK S'.h t:0LUi\^)».^vAr^r-1yCfi 
'•/.j. G! Titf' 

f».-.yi,C':; f: U. m"S>LNTi-Ei IN !'MF 96- COLUMN CAtti *Y IMF iWONu ^ 

1 !•* .t' I-" b4 I L»#I«L ; 

TlfL*/ !>.nS 7.U r;> : f . I f ANFUi :< . 7 Hi- 6- lOI fUClttC '.V. , !fN?. oILL Dt 



7ifL-, t.ns au r:>:f.ic:^r anfu':<. th;- a-i<h 

CuVi.U'/> i.iJC'l iih|.C iHGKOIUML < JIN* C! Al i LK /| 
, Oil » .V: Fr! \ ^'J<W 0 T iwTr^.H OK UM: ALPHA 0? KUi 3,T'^ OK 

Mr. •O'i.V ' ^ „ * 

y>,f .'i it de.'A.n asj-MhP» "UT; c charactcr i«ut 

lo r.L.'U. IrlL p-ftTT CUDIWii SCMfME *£SU * T OFFICIALLY •CbVIWfc 
I U \ CI. t.r, : i; o 4 

7fUi 1 if X f 1 

/.i -t.il 7 ton r .ioo; , " * 

,T ^'i't 1^-*. Nilitffcfl F in. A IN COuUMHG 1-20 UGINfi A ^OKTLKt UH fCH 

hi 'r«.>. < T^'t. iKJiKk IIP ANY liORf FOK\A hACHTNS PROM LFA3T SiUNlKI^ 

Ul hils'.f GIWrPICAMI 
%AUKC710M , 

TO :;^I A 4Urt.K ?J/ CAr<HS> fiY -CT7Y- MtTHIW COUNTY WITHIN STATrlt WHICH 

n.& i.n: Kinr*o would be ihc ..AoT as. soried? - 

X.^ToWj ST ATE 4 . * 

k... hO.';T ^ T^ J^ <F TCANT FIELD MU?>T Cf SnfVTEfi LAST 
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EXHIBIT *7 (page 3) 

zflnrviioN it UK. ■ 4 ri.rr go in • r i '-6 » - 
t—M -rt>u r-f.lL iisai i«.u ssoci.u rs-jfat t.i;o i^s-sur^ C'.r.r. u* no> 

ZNilJrftrtl YCl. 
TCHLUJmiL r«i # 

YuM iiT* M)T mJVJER n<l»Uf;U Hi!- P I i ; \K!/CUY fHiZ FJMST ftTtfh.'T 

I Art SbN.'iiHr-YUlJ r*..'JI«' lu KfrLi.T f.-ic LibfiN 

ro a*m iuuf. k.' /H m ruuu. 

T.LL KlbHT.' EtlfcCE VOij ANSbCi - »> ."Hf a-.J£ST10N5 fclFI 1. CM'Hi^H 
Xc.m » 



/ 

6 



V 
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EXHIBIT 38 (page 1) 



/kUN GNOSISC600r61l3 . " • 

GNOSIS version i.l n«;rch U974. 

In>-ut name of lt>sson filelwith extension or push return to stop* 
■/nim.cno / || 

Translation of the lesson "UNIT4»GN0* has be3un«««? 
• *nd ready. 

Input name of lesson file with extension or push return to stop,. 

y . , 
/ ■ . 

END OF. EXECUTION 10K CORE / . 

EXECUTION TlhE:\22.05iSECS. 

ELAPSED TIME: \> MINS\ 28,33 SSCS. 

.COMPILE UNIT4.ALG 
ALGOL J UNIT4 

I1XIV . ' 

• L0nD~JJNIT4 
LINK: " Loadind 



ILXI1 ( 1 

.5AUE UNI-T4 
Job saved 

.RUN'UNIM* 



This is the lessor, *UNIT4 • Produced by tfie CJNOSIS system 
foi; computer aided instruction < CA1 >' from the Research^ 
Institute of National Do fencer Stockholm* Sweden. * 
The teacher who wro^e this lesson m , t 

CSClOOr UNIT 4 ... e . . ' 

IMPORTANT? You con interrupts the Vesstfn wherever you want by typing 
the single character l j 

^on your terminal and then pushind the RETURN 'button. . M 

Ther**af te r» you can* - ^ \ % * 

leafve tne whole lesson or 
-? skip Jujst one Question, or . v% 

-v back up -to previous parV of the lesson. 
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EXHIBIT Sa. (page 2) 

THE E'ASIC PHILOSOPHY OF jpjtlNCHbtf-CARtf DATA PROCESSING IS 
to; RECORD SOURCE. JJfffA AS/HOLL.S- PUNCHED INTO CARDS AND TO 
PROCESS THIS DATA WITH THE USL" OK MACHINES. " ' % " 
To continue* push RETURN* 



4 



UfcAT TWO CHARACTISTICk MXOU PUNCHCD-CARD DATA PROCESSING . . 
TO HE AN ADVANTAGEOUS METHOD OF* PROCESSING D&TA? * \/ „ 

(GIVE 1 HE CQRkfCT "NUMBSR FOr> YOtjW ANSWER* ) * , - 
• 1 MACHINE SPEEDS AND REPLACING CLERKS ' " ' 

2 RLPETI riVE 1 USE OF^D^TA AND INTEREST* IN UJORKING WITH MACI^NES 
♦3 TO UTILIZE KEYPUNCH TALENTS* AND THE HOLLERITH COtfE ' * 
A REPETITIVE USE tCF DATA^^ND MACHINE SPEEDS ♦ ' ' 

INTEREST iy WORDING. WITH MACHINES IS NOT AN ADVANTAGE OF. TH£. > *• ■ 
PUNC<iF.D CARD METHOD FOR fc'ROCESSI^G DATA* * - #\ '< 

Try H^ri* * ' • # * " « , 

WHAT . •TWO. CHARACT 1ST ICl> ALLOO f'LJNCHED-CARD DATA' PROCESSING 
% TO HE AN 'ADVANi AOB UCTS mLYh^D er PROCESSING DArTW? * * ' * v 

(GIVE THE CORRECT NUIWER FOR YSUfo-ANSWUx • > " 

1 MACHINE SPEEDS AMD :<EPLACI)Mi °ckgRKS .' 0 * ° • * • 

2 •REPEriTIVE^USfv OF DATA ^.ND ITrr£REST JN^ WORKING WSTH MACHINES 1 • « 
■»3 TO UMLttZC* KEYPUNCH JmLENTS AND THE HOJ.LER^TH OODEj ' \ 

4* REF%TITjfv£ .ClSE OF 6ATA AND MACHINE SPEEDS* - 
?4 * • • ♦ » * •* 

Nog you're cutchirig tfn! * • , * • 

* ;. 'To continue push RE TURN •% \ * ^ ' " .* * * * 

Answer "tvTOh* if you want to leave this lesson t * '\ . # 

* • 'SKIP" if * you, want » to skip this Question* * , 

* "DACK" if you* want .-pa 3o back- to an earJLier part of the lesson* 
J CONTINUE.* if- you/3nt to* continue. " * j * . . ' 

'fSTOP , . ; * 

* ■ * "End.of. le^on •uhlIT.4 1 '* , ' , ' • ' « ' * \ \ 

< r Yocr have answere^J 4 1 o<iestionsf ar.d you'^civ^ the ridht >Snsner. # 1* times 



4 On 0 uuo&tioi 
on • p - ^ 



ris i>our answer was. ri'ifht *the first time you dot the auestj. ■ 



Tijis lessen has f fodu^ed*-a *pe.^ort sheet for «the teacher/ 
This sheet will rr ( inted on the 1 {n^*p^iriter • ' , 
* Fleaso senrJ the line printer listing * (not the' ^istii^d 
•. at \hh* convers Aional termir»e; ! 0 to "the teacher. ' * 
Hg- Needs the lis^ind to irtiprove^ the 'lesson; . J * 0 
You cap send it anonymously — the teacher will • 
'*not *V now "which student sent' it- to him* .* 




The name and address of the teacher is* 
CSClOO'f UNIT A ' * " 



To continue push RETURN. 



If you have any message, *f or the teacher* then, write it now» 
Finish with an* extra^ push on the RETURN key» *' * , • 

Exitind f.rom* lesson f UNIT4 - » ^ '* > 
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1 (Jftl .WITH' A NEW TwiST 

* * *■ 

■ . % •» 

Lawrence P. Hue^man, Lotus M. Knief, and John Luiten 

" * .; ; . I 
r " University of Arizona, Tucson*, Arizona 85721 



ABSTRACT . On the basis of improved performance vitti the.use^of tutorial HU 1 i — rnS t i lilnhlr flexible 
and; machine- independent system for an individualized CMI course is being developed* In addition to 
optional lessons, the system will^include a router. to access lesson, test, ^problem application, and 
record, files,. A unique feature is v the, application' package with diagnostic feedback. « N 



Tt^e project to be«desc*>J/bed in this session t • 
represents the further development pi a^Nj^ivid-' 
ualized computer-based instructiou*system already 
in operation at the University of Arizona, called* ' 
LERti. One application has, tje&n ysejj ^ith 70 tuto- 
rial statistics lessons developed Knief, which J, 
have markedly improved student performance in var^* 
ious classes in several departments. * * 9 

A multiple regression analysis of Educational . 
Psychology statistics students using and not usinf>*» 
the les'sons was calculated. Results revealed a 
difference between meaus, significant at the .01 
level, in favor of those using the ljssons, with 
neither sex nor class 1 standing (i.e*, whether "a 
'student was junior, Senior, or graduate) having 
any effect. Furthermore, the semester grade dlsJ- 
teibution in" classes using the lessors has changed, 
from the typical nqrmafi shap^e to a skewed" distri- 
bution with more A's aiyl Bjs. Along with the* 
markedly <4mf>r0v'e4* i perf ormance has beet\ a very* 
favorable acceptance and appreciation of the les- 
sons by the students. 



*er|c 



The I.ERN system, however, lacks iNyyfa"l desir- 
able features to make dt even more wftJOsv appli- 
cable: (1) a system for completely individual- 
izing instruction for large numbers o£ students; 
(2) an individualized problem application arid 
£eed6ack package,; and. (3) an aid for prospect- 
ive instructors. In the past, attempts to indi- 
vidualize learning have included such, efforts as 
creating multiple, smaller-sized sectidns of a 
large class; hiring numerous instructors to teach 
these sections; making use of tutors, help ses- 
sions, hand-out sheets^of problems; and other such 
devices — all of whiqh have not solved two major 
problems: 1) individualization of large numbers , 
of students *on*a widespread *basis ; 2) achieving 
such individualization,!^ the face of currently 
severe hiring and budget restrictions. , m 

There is a general agreement that the use of 
computers in education can enhance the effi- 
ciency* and effectiveness of learning. The rea- 
sqn apparently, is the provision of improved 
learning conditions, especially in relation to 
the computer's. ability to create a highly pinter- 

V t . ' « ■ 



^ctive learning environment where learning can be 
4 individualized (Bell, 19?4; Educational Techno 1- 
' ogy. , Nov., 1974, entire issue). 

v „ Even though the comp.uter has been found to be 
^effective for learning in«,a context of individ- 
ualized instruction,, -those educators mo&t in need 
\bfits assistance often are* the least pjrepared and 
able ># in terms of time and skill, to develop large 
amounts of computerised instruction. These edu- 
. cators*also tend to~a^Ctively .fear computer tech- 
nology, which adds to^tlieir disinclination to use 
the* computer's capability in* their own 1 instruction. 

,* " . * «» V • 

What is needed Xs a 'managed individualized ti\r 
struction system t?o*help solve these problems on a 
widespread basis. andVat reasonable cos^t in keep- 
ing with today's budgetary constraints. This sys- 
tem would provide for pre- and pbs't-testing of 
students, presentation of assignments i administra- 
tion of individualized application problems wtth 
a unique step-by-step diagnostic and' remediation 

^capability; with the option of adding Computer- 
based instruction lessons if desired.. The system 
should be as easy as possible for instructors to 
use, to overcome their fears and help insure 
adoption. * t * « «- 

J \ 9 *« . * 

Computer-managed instruction (CMI) appears ^to m 
be one of the b\st solutions for *t\xe following\ 
reasons (Baker, 1971; Belt STSkubal, 1974; Lippey, 
1975; Spuck & Owen, 1974*; Young, 1974): 

1. It uses conventional materials and operated 
* well .within the traditional classroom set- 

ting, reducing costs and major educational 
program alterations* 
2* It solves the most serious problem of indi- 
vidualization for large ^numbers of students, 
i.e., management < » * 

3. It»is nonthreatening to instructors who ; fear 
computers, since it 'is a "tool" for their 
assistance in managing individualized 
classes. 4 " » 

4. Since it is controlled by the teacher, it 
has greater probability o^ being used. 

5. It helps ease the staffing and budgetary 
difficulties in education, "because one or N 
two instructors with an assistant or two 
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could handle large numbers of students in 
an individualized cours ! using CMI. 



The goal then Is to develop 1 universally 
transferable system (written in FORTRAN) for -indi- 
vidualizing, instruction^, for large numbers of ^stu- 
dents with minimal costou'se of .few faculty, and 
use of tcdinary instructional materials. 

* , • • 

Basically, the system, would consist'bf four * 
parts: • • 

1. A Router; - 

2. Computer-based instruction Lessons; 

3. An innovative step-by -step individualized . 
y * Problem Application and Feedback Package; 

' 4. A Monitor. 

Roster would access and manage tes*t item, 
feedback, assignment, problem,- and perrtnrmance 
files for student interaction. The interaction 
would be of the following type: 
A pre-test.- 

If criterion is, met, the post-*tes/ could 
be taken immediately, for grade. 
If the criterion is riot met, the learner, 
would be given an assignment, possibly 
computer . lessons , and application problems 
for stu<Jy ancl feedbacKi^>efore the "post- 
v test could be taken foW grade. 
The system would randomly generate items 
for the pre- and post-tests and for the 
application problems. 



1. 

2., 

3. 



The Lessons provide .a tutorial mode . A com- 
plete set of such lessons already are available 
for statistics students; their success was des- 
cribed, earlier . 

The Emblem Application anci Feedback Package 
.truljj is unique and is described below. 

The interactive course preparation Monitor 
would be used by instructors at a terminal. The 
monitor would lead an instructor painlessly " v 
through the steps necessary (entering items, as- 
signments-, ^answer decision rules, problems and 
feedback) to iise^the system. „ * 

- r '* 

Such a complete system as outlined could, be 
used in any course at any educational level. 
The completeness of^ the _system and relative ease 
of . use should make adoption more probable and 
the potential cost-benefit ratio quite attrac- 
tive. ' • 

Development of the Problem Application and 
Feedback Package ts a truly unique innovation 
in that it would:" 

1. generate an individualized data set for 
each student to use with problems apply - 

- ing tfhe concepts he* has "afequire4 in his \ 
lessons* Each student's data set would, 
be 'different from the ,dat* set provided 
for any other. 1 

2. increase the development of the student's 
problem solving ability by diagnosing his 
results on a step-by-step basis and by 

" giving feedback and providing remedial 
learning as necessary at each step * 
( 3. record the prpgress of each student, cor- * 
recting his work as^ necessary , and provi- 



ding him with additional assignments as in- 
+ dicated on t;he basis of performance. * 

The advatiages of providing such a .step-by-step 
capability tji augment the learning provided b>v the 
system are piny. Some of the most significant ones 
ere: ' J 

J., the [student would 1>e able to gfct immediate 
* assistance when he encounters a difficulty 
# in his problem solving efforts* , Further,, 
this assistance would be available at any 
1 time, day or night, withoutvbeirig constrain- 

ed to the availability 'of an instructor. 
2. the* help fhat would *b'e available for the 
student would be on a personal basis simi- 
lar to a one-to-one relationship, <which' is 
flop the case in the 'typical d'ass. - 
. . 3. fhe student's work would be evaluated and v 
graded immediately after submission, since 
he would receive immediate feedback on tjie 
* correctness of -his work, and, if.necessary , 
be given remedial learning to correct .his 
errors. 

< 4. the student would be compelled to work* in- 
- dividually since his data set would be dif- 
. ferent from that of any other student. 
5. since each student would need to apply what 
he has learned , it would make that learning 
relevant, •this means that each individual, 
student would transfer, somettf ing. .that has 
been extremely difficult to insure in ordi- t 
nary Instruction. * 

As may be seen, this project has a good lesson^ 
. basis already developed and being used actively. 
Further documentation of the use of the lessons 
will become available as a result of research be^~ 
ing conducted currently. A number* of time series " 
and regression, studies are being done on use fac- 
tors such as computer time per lesson and its vari- 
ation, and lesson use relative to time of- day, % 
week, and month. These factors are being 4#ela^e<l 
^ to lesson performance and course performance. ( 

Xt may be seen that^wo are attempting to make 
significant additions to an ongoing, successful 
system to y establish it as a completely viable 
system with the distinctive features described: 
The additions promise to be o,f .direct practical 
value, to be widely applicable, and to result in 
more effective and cost-efficient instruction for 
each student. The savings in 4 multiple faculty 
salaries, ^extra help, sessions, tutoring, and. hours 
* of time for both faculty and students are incalcu- 
lable but considerable. /Furthermore, • this system 
makes the typically exorbitant costs of materials 
. development unnecessary, since'.an instructor's own 
exercises, test items," assignments, and so on may 
be utilized. We believe that the proposed system 
translates into an increase in student-teacher 
ratios and a decrease in learning time, all wi$h 
improved learning,, and thus into lower ove'r-all " 
"costs. * « 
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ABSTRACT: A commercially available Computer Aided 'instruction (CAT) system is brief ly, described. Its,, 
application in the elementary grades of a small school. system^ (Sierra Vista Public Schools) Is discussed. 
Student performance beforehand after 'introduction of CAI is. apalyzed to -assess fmpacj af the sys*tem.' 
Some of the factors to be weighed in selecting CAI systems ap« presented. Suggestions are given for 
establishing a successful CAI program, « * ^ 

%V ' * * * J£LV 

Figured illustrates Sierra* Vista's organizational 
relationship of/Title 1 and other elements of the 
, district.! -A totaf of $132,090.00 was allotted for 
1 tKis school year's Title Inactivities. /Approxi^' 
mafcely $40,000.00 of this money was used tOplease 
* the computer aided instruction system from Compu- 
ter ^Curriculum Corporation. This is the fir*St 
Title I CAI system in'the"^tat$. Indications ar.e * 
. that we will be funded to continue ne*xt year in 
order to better evaluate the results. ^' 



This afternoon I'm going to discuss several 
aspects of the Computer Aided Instruction System 
used in the Sierra Vista Elementary Schools. 'The 
funding for this CAI system was provided under 
ESEA Title I. It's appropriate, therefore, to 
spend, a few minutes reviewing the Title I grant m 
system. 

The federal government has ,establ i srfed a pro- 
gram of additional instruction for chi 1 oren who 
i are "educationally disadvantaged". Examples of 

such children are those#who have missed large 
* * amounts of school due to illness, those who have 
changed Softools frequently and those whose native * 
language is not Engl ishV^tttta^chi ldren who have , 
these problems are able to maintain their class- ! 
room work but those who fa 1 1 behind are consider- A 
. ed to be el igjbld^or Title I assistance. J This 
program fs no£ a part of the Special Education . 
program which provides extensive work- with the 
chi Id wfio is 'handicapped. Funds for Title f 
programs .are determined &y the number of low 
income fami I ies in the school district. This 
». number' is calculated from- the results of several 
statewide surveys. However,, el igibi li ty for the 
program is -not determined by income;* it is based 
M on. the child's school a'chievement. Therefore, a 
o child from the area' * wealthiest family could be • 

considered* 1 Educational ly" disadvantaged" wfii hi 
. .-children from the state identified 'Mow income 
^families" are not necessarily eligible tor Title ^ 
X 1 aid. .The funds for, programs in Arizona are 
administered £>>a,Title I Divison Director who 

is located in Phoenix. 
• » 

The 1975-76 Title I program in Sierra Vista 
ttsts of nines tutors to^work with first, 
second and third grade students in reading and 
ten computer terminals to be 6sQd by students, 
grades, 3-6, in reading and language and by 
students, grades 1-6, in mathematics. Three 
computer "monitors" were hired to staff :the 
•.computer rooms in each of the elementary . , * 
schools". Additional staff included a reading 
special i$t: and a math consultant, who Were to 
coordinate classroom ano 1 Title 1 efforts. 




^Sierra Vista ^s located in the southeastern 
part of Ar i zona , aB<5i t 80 miles from Tucson. The 
population is 20,000 Vnich includes 8,000 persons 
living on Ft. Huachu\^'\The major employer in 
the area is the federaT government, ; A majority 

< of the Sierra Vista working population is connect- 
ed with Ft. Huachuca as active duty military, ,* * 
Civil Service or support personnel. Jhere is also 

. a growing commuw^ty *of retired military persoris. 

- The Sierra Vista School Oi strict has nearly $,000 
students. Children living on Ft. HuaChuca, attend 
county run" accomodation schools untij ninth grade 
at which time they enter the 'Sierra Vista" system. 
The district itself has three elementarytfschools, 
one junior high school % (grades 7-9) and "6ne # senior 
high school . 4 • 

: m 

One problem facino^'the school district fs a 

- .high student turnover." Department "of Defense 

"* ^employees, bdth Civ; I Service and military, may 
stay. for only si* fliprrthsv In addition t(ier.e is 
a Targe amount of building in the area, many 
Children of construction workers, fol low their " 
pacjents from job to jobT As in any rapidly 
developing community, school facilities are not 
quite keeping pace with the increasing school 
population. It w4s= recogniied that £here were 
students % fn the district who, although not eligi- 
ble, for 'the Special- Education program, needed 
instruction in additionjto that which* they, were 
receiving in the classroom* A decision was made > 
tfb begin to remedy thi.6 situation at the elemen- 
tary level firs*t. The result was the Title I 
"proposal for both a tutor frig and a CAI system. 
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Ttje computer aided instruction will now be discuss- 
ed in more* detail .. * t 

AU the hardware (that is, the ComputerLand 
*%ts associated electromechanical .equipment) was 
'furnished by Computer Curriculum* CorporaWon (CCC) 
undor'a package agreement. The' computer itself is 
a^model;/f 16 mi r?i computer, buitt by Cincinnati ' s 
MhacYon/ tfie parent* corporation of CCC. Onedfsk 
dri'tfic .provides mass rriemory. Student^jja^biAeHriter- 
faceiis via* ten ASR-33 teletype -terminals. Fodr 
'of these terminals are located wjth the computer 

• at CaijrricTtaet Elementary School 4 three each, are 
remotely $oca,ted at Bella Vista and tillage 
Meadov^ytrcmentary Schools.* The remote terminals 
are linked to the computer by dedicated telephone 
lines leased'from Mountain^Bel 1 . figure 2 i% a 
blocl^ diagram of* the computer system. * Al4 required, 
maintenance is performed by Computer Curriculum 
Corporation as part ^f its contract. 

** " * 

All system and application computer programs 

(that is; the software*) plus curriculum material s^ 

are also, provided* by CCC. Details concerning 

program structure are considered proprietary by 

CCC and cannot be discussed hece. • : • 

• Tite elementary curriculum packages -used by 
Sierra Vista Public Schools provide users with 

• three services; 

' A. Student Information Entry and Updating 
B- Student Progress "Evaluation and Reporting 
C. Student Drill and Practice* + 

Each*serv.ice wild be described in detail. 

> 

A. Student Information Entry, and Updating 
After a child has been selected for the' 
' »CAI pr|grara, he is assigned an identify- 

ing number. No other student in the % 
.« system w-j 1 1 have tt) is 'number. The 
* • ■ fol lowing information is^then entered: 

1. Child's first and last name 

2. The primary classroom teacher's 
identifying number (A second 
teacher's number is optional; 
this feature allows more than 

t one -teacher to receive the • 

chilli's weekly report.) ' 

1 3.^ The CA1 course 4 in which he/she 

is to* be enrol Ted (reading, 
language arts or mathematics) 1 

"4* Jhe starting grade level in the 
course (The level is determined 
by scores from two achievement ' 
tests' which th^child took before 
* he/she entered the Title I pro- 
gram. The beginning level is . 
1 approximately Six months lower 
than the test scores would indi- 
cate. This guarantees that the* 
Studeot*wiU -baye a high initial 
: success 'fate and will build the 
confidence often lacking in poor* 
♦ students.) , 

5. If the student is being enrolled 
in mathematics, the Tength.of 
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each session must be determined. 
This length may vary ;fr.om five 
to ten minutes. AH reading, and 
language arts sessions are.f.en 
minutes long. The math course 
also has a variable timeout 
feature (the amount of time a 
student' has. to answer each 
question). . Reading and language 
arts have a fixed timeout of 60 * 
seconds, while the math course 
timeout may range from 30 to 60 
second's. We use the 30 second 
timeout for all students except 
children working on a first or 
second grade leve ( l. They are t , 
given a 60 second timeout,. * 

If a student is being enrolled 
in, more 'than one course, return 
to step *3 and continue, f 



An example 6f a Student's enrollment is 
Figure 3« > 

If the entered information needs to be 
updated (for example, a child changes * 
classrooms or adds .a course), a similiar 
routine is followed. The old informatioii 
is displayed; the new typed in to replace 
the .outdated information. 

A) 1 entry data must be done using a pass- 
word. In our system, this password is 
available only to the math consultant 
and* the, dbmputer monitors^ No one else 

, * is able to enroll students-. 

* * « ♦ 

The ^computer system i tself updates a 
student* s grade -level . # during, the / 
firjst ten sessions in a course, a ?/ 
student's grade level may change a V 
half year per session'. .If jhe/she f < 
• answers less thSn 50%«correct1y, *the, 
grade level f 'is decreased by six months. 
If the score is more than 95% correct, t 
the grade level is increased by,'s^x 
' , months. After f the t initiaJ ten sessions, 
students advance and decline at a slower 
rate» Each course is divided into differ 
• ent strands; the child moves in each 
1 strand art his/her own pace, for 

example, the mathematics course Kas 1*4 
strands. A child in -the first grade 
might be working, on five* of them.. The 
grade levels might be: . $ 

1.5 Numerical Concepts 
1 .2 JJorizontal Addition ; 
1 .V Horizontal Subtfractfon ' 
, 1. 1* Vertical' Addition 

2.0 Vertical Subtraction 

~i t * 
The average score for a course is/a 
weighted average of the strand scores, v 
A chi id enrolled at the fourth grade 
level in mathematics would 'be working 
in 13 strands. In reading there are 
six different strands while in lan- S 
guage arts there are'seven stranfls. 
^ In a course' the chjld progresses in* 
each strand according to his/her J* . 
performance in that particular sub- 
ject area. ' • 
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B. Progress Evaluation' and Reporting 
The classroom teachers receive as a 
weekly report' a printout of their , 
students* current grade levels. This 
report can bet run at any time interval 
since the students? level is updated by 
the computet systero/*fo1 lowing each 
session completed by that student. A 
clay by day report, however, generally 
shows little change and simply in- 
creases the amount of paperwork handled 

■ by, the teacher. The computer monitor 
also keeps a copy of this weekly report 
with her in the computer room to be 
available if the principal or other* . 
official would like a quick report of 
the students' progress. The math con- 
sultant and the' reading specialist 
fceep^cumulative reports of aN CAl 
students.' weekly progress, Th^e 

* rfccords N wi11 be jjsed in evaluations 
of the Title I program this summer > 
Reports can be keyed by student, by 
class and course, by class or for the 
total Title 1 enrollment. Figure „ 
is an example of a class report. The 
report routine does^ not require a pass- 
*word; in our practice, no one runs the 
report routine except the math consul- 
tant and the three computer monitors, 

C, Student Orill and^Practice 

A student accesses the system by turar 
ing the teletype to on-line and push- 
ing the space bar. The computer 
responds "Number and Name, Please*, 
The child types in his/her identifying 
number and fir$,t name. If the computer 
* recognizes the student as a valid user, 

* the child's last nfcme is printed along 
wit'fc the date, time and a "Hello" v 
message/ The' child must then type in 

^ the initial of the course in which he/ 
she Is going to work. The "entering 
:_jroufine was readily mastered by our_ 
only first jgrader using the system in 
less than one* week; it is not difficult 
to handle. The computer then types a 
question for the student ,to answer,. * 
The reading and language arts lessons 
require either a or)e word answer or a 
number response. If the wrong answer 
is- entered, the result is "//////The 
answer is'. . . ,", A "timeout" (a 
delay of over 60 seconds) is considered 
an incorrect response. Figure' 5 is an 
example. of a reading lesson, "The math 
lessons respond to a wrong answer with 
"Try again", * If a second incorrect 
response is made, the system returns 
with "Typ e • # " (the correct digit), 
,so that the student eventually sees the 
correct answer, Responsfcs to problems 
written horizontally are made left to 
right*. Vertical problems require right 
to left entry for the answers, .This 
a 1 lows- students to, answer the problems 
in the order that thoy arc calculated. 
Scratch paper and pencils arc available 
if they are needed. Figure 6 is an 
example of .a math lesson*. 
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At the end of the allotted time for 
the lesson, the number of correct 
answers is listed and the^ student 
is invited to continue. If the 
student indicates (by striking the * 
space bar) that he/she wants no 
more -lessons at that time',, a "Good- 
bye" message is^printed. The student 
takes, the lesSon printout, to his/her 
classroom where, ideally, \ the class- ' ,* 
room teacher goes over the\problems 
with the student. Children often 
take the papers home t to discuss them 
wjth his/t)cr parents'. 

Students were ^Bfet ed for tne CA! program 
mainly by teacher re«Sfipendations. The criteria 
used by* the teacher! were: 1) the? child could not 
be on the official rost*/, of Special Education 
students; and 2) the child must be performing 
below classroom level in**reading, mathematics or 
language arts. Scores from the Iowa Test of Basic 
Skills (1TBS), administered in early September, 
were .suggested as guidelines for selection. Orig- 
inally, the teachers were told to refer only three 
students. Later, as the program was better estab- 
lished, more students were added. Currently we 
have 210 student? in the CAl system. Thirty of 
them are enrolled in more than one course. 

The terminals arrived at the elementary 
schools at least one week before they were in- 
stalled* Therefore* many students were aware«o,f 
them and were asking questions about the terminals. 
Children who were to be in the CAl program were 
introduced to the computer over a two day period 
and were allotted about twenty minutes for a brief 
general description of the system and their first 
"hands-on" experience. The reaction to this 
exposure was almost unanimously astonishment, 
especially when the computer, "knew" their last 
name. The monitors sat with the students for the 
first three days to encourage them and remind them 
of what action was required next. After that, the 
children were ready to work on their own. The 
monitors still remain in the Voom but students are 
encouraged to do all their own work. The monitors' 
are instructed not to give answers to the children. 
However, they often will review the questions with 
a child after the lesson is comp1ctc> A large num- 
ber of students have experienced difficulty with 
the measurement problems (money, weights, lengths, 
etc). The monitors have made special aids to 
help in th1s>area. There are either posters with 
various measuring relations or handouts with 
similar information on them. In most instances 
there is a warm relationship between the moni'xor 
and their students, ' u 

After five months the initial bubbling enthu- 
siasm-rfor the computers is still evident in at 
least ten percent of the children, Vhile the * 
great majority of students enjoy their CAl lessons, 
it has become a routine feature of their regular 
school day. One sixth grader could not tolerate 
her computer lessons; the pressure she felt left 
her near tears after every session. Her teacher 
talked to the girl and found-that she wished to 
discontinue her CAl time- WeAyeVe agreeable and 
she was removed from the enrollment. After sever- 
al months some students appear eo^to be bored. In 

/ * ." 



order to counteract this we dicl several things. ' 
fls an incentive toward higher scores, a plan 
was set-up to recognize the students who missed 
no problems on a day's lesson. At Carmichael 
School, there is a chart in the computer room 
listing each child in the CA1 program. ,A red 4 
square is placed after a student's name each , 
time he/she received 100/6 on the lesson just corn-* 
pleted.' At Bella Vista and Village Meadows' 
Schools, "Happy Grams" are given when a child 
has a perfect lesson. .These "Happy Grams" are 
telegram sized papers with smiling faces printed 
along the edges. A message is wfitten by the 
monitor congratulating the child on his/her 
achievement. "Happy Grams" are also given to 
those students who, although they didn't make 100%, 
did much better than, their usual score. Another 
method, that is effective in rekindling a dying 
interest in CA1, is to allow the child to work on 
fixed strands or topics. Fixed strands is an „ 
option of the mathematics course which allows the 
child to work on only one p strand per Session. 
Host of the sixth graders spent two or three weeks 
on the fractions strand. Fourth graders may bene- 
fit from and enjoy spending a few weeks on multi- 
plication drill. Topics is a feature similar to 
fixed strands but it works in the area of language 
arts. A child can be enrolled in contractions or 
noun-verb agreement for example. It seems that a 
student's interest increases with a week or two of 
concentration in one specific area. However, the 
interest continues at the higher level ieven after 
they are returned to their regular program. We 
are working into other means of motivating and 
continuing to motivate the CAI students. 

^ . 
Although only the students who are below 
classroom level are working in the program, 
there'<& been no problem with children being embar- 
rassed or feeling inadequate because of this 
special attention. In fact, the opposite seems^ 
to be occurring. The children are proud £}jat the^ 
are chosen^ to work on the terminals and are often 
the envy of their classmates because of their 
op^ortuni ty' to do so. 

\ 

Host parents learned of the CAI program 
through their ch*i Id. Ther ( e has also been a "local \ 
television interview on the system and articles i 
in the Sierra Vista and Tucson newspapers. The \ 
CAI program ttas been discussed at PTA meetings. 
At one Carmichael School PTA meeting, the parents \- 
were allowed to complete a lesson themselves. At \ 
Bella Vista and Village Meadows Schools, letters \ 
were sent to the parents of the* CAI students in- 
viting them to visit the school at their child's 
scheduled computer time and See the program in 
action. We had a good response (better than 50% 
at Village Meadows) with many parents taking 
time off from' work in order to see this new 
method of doing lessons. The chi 1 dren enjoyed 
having a chance to teach their mothers and 
fathers how, to use the terminal. Most of the 
parents said that they were pleased that their 
child had an opportunity to wortt with the com- 
puter. There is a standing invitation to# 
parents to visit the computer room at anytime * 
during the school day. t . 
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Although the program is still young, we al- 
ly have several success stories, for example: 



Troy H., a second grader, was unable 
to master even the simplest addition or 
subtraction facts. He was placed in the 
CAI program. After six weeks, he had not 
only caught up but was ahead of most of 
his class. Since he had accompH s'hed his 
goals, he received a "Happy Gram" from 
his monitor stating he had completed hi-s 
computer course and was "graduated" back . * 
to his regular classroom. 

Annalisa B., a-third grader, "scored 
at a grade level of 2.** in the arithmetic 
section of the v/ide Range Achievement. 
Test (WRAT). That was ten months below 
grade level. She spent **3 sessions in 
the math program, and increased her arithe- 
metic WRAT score to 3.6 which put her one 
month above grade level. * 

• •% 

Our most notable successes have beeft our Viet- 
namese students. Most were in the area'for only a 
few months and were unable to be pre or post test- 
ed because they understood English so poorly. - 

Quang Ho, a sixth grader, who worked 
in the program from* November 25 to Janu- ^ 
ary 30 increased his course grade level 
from to 5.0. 

The official teacher orientation was through 
a one day seminar conducted by CCC. Our Title I * 
program was funded and operational by late Septem- 
' ber, more' than a month after school had started. 
It would be an impossible task to get substitutes 
for all of Sierra Vista's elementary teachers. 
Therefore, a decision was made to have the seminar 
presented to the grade chairmen from each of the 
elementary schools, a total of 18 teachers. The 
presentation consisted of .a slide presentation of 
CCC's results in other school districts, an ex- 
planation of the Tftle I program as it was to be 
run in Sierra Vista, and some "hands-on" experi- 
ence for the group. The idea behind choosing the 
grade chairman to view this program was that they 
would present the material to the other teachers 
in their grade. Some did an excellent job, some 
did nothing and mjfet were somewhere in between. 
Therefore, the classroom teachers received~a wide 
range of information or misinformation. This, I 
believe, v explains in part, the variety, of responses, 
by the teacher to the Ca1 system. I feel that the 
teacher's use of the program is the single most 
important factor in affecting the child's progress. 
If the lessons arc used as they' should be, as a 
teaching aid, the student can make great strides. 
By reviewing each day's lesson, it may be seen 
that the child has a specific problem, such as 
being unable \to borrow, then that particular area 
can bereinforced by the teacher. Our CAI system 
is not intended to tea*ch concepts i it is to be • 
used for drill. -and review. Alone the CAI lessons 
are of more benefit than a page of arithmetic pro- 
blems or a language .assignment. There is immediate 
feedback after a child*s response. Jhe difficulty 
of the Wessons is adjusted as the student pro- 
gresses. This car\J?c used by the teacher to dis- 
cover the chnlcfs gaps in "knowledge. 

Most of the" teachers collect fyie^pHn touts as 
the child returns to class and go ov^r them as 
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time allows. One .second grade, classroom incorpo- 
rates the work of its t hree C A1 studen ts into its 
regular mathematics lesson. ~ - ' 

.The weekly reports are used mainly as general 
indication, of the students progress. Many teach- 
ers have Raid that the reports indicated their 
students were working on a lower level than .they 
realized. .This is often caused by gaps in a 
child's k/iowledge which can be hidden when work- 
ing in the classroom. If scores in one or two 
strands are noticeably lower than, the others, 
perhaps extra drill in those areas is indicated. 

Academic progress made by the CAI students 
can be measured by three different means: 1) the 
grade level as computed by the CCC system; 2) pre 
and post Iowa Test of Basic Skills (IT6S) scores 
and 3) pre and post Wide Range Achievement Test 
scores (WRAT). Usually the ITBS is given in early 
fall, however, the Sierra Vista Schools are chang- 
ing to spring testing. Therefore, this school 
year we will have two ITBS results. The Iowa 
tests arc given schoolwidc; there is no makeup 
date. The WRAT test is given as a child enters 
and leaves the Title I program. The only excep- . 
.tions are if a child speaks no English or if he/ 
she moves without giving us notice. The grade 
level calculated by the CAT system as based on the 
students performance is available every week. 

.< » 
The .establishment of the Title I program, for 
the elementary schools has had an addi tional Ad- 
vantage. The math consultant and reading special- 
ist are available to the classroom teachers who 
have problems or questions in which they would 
like an outside opinion. Th^ere is now a group 
responsible and able to work with those students 
that seem to fit nowhere, they are not handicapped 
and therefore could not be helped by the Special 
Education program, but they are not performing* 
adequately in the classroom. r- 

* i 
Now that the Sierra Vista Schools arc on their 
way to becoming veterans .in CAI usage, we feel we 
have conquered some problems and are better able 
to cope with others. There was, for nearly six 
weeks, almost continuous difficulty with the v 
modems (the electronic devices connecting ter> 
mina'ls and the computer to phone lines). The two 
remote location schools, Bella Vista and Village 
s Meadows, suffered a lot' of downtime. This was 
di scouraging "to both monitors and students. The 
children were reluctant to come to the* computer 
room' because so often when they did one or more 
of the terminals were inoperable and they would 
have to return to clas"s without working on their 
lesson. Fortunately, the problem was solved by 
acquiring a new type of modem. The referral 
system will go more smoothly now that lines .of 
communication have been established. Next year 
we hope to be able to fill at JeastNulf of the 
computer slots by the second week o f ^ " m pl . 
Attendance has been a problem for a few students. 
It is important ^that'the child do a computer 
0 lesson each school day, if at all possible. ►Of 
course, during special times such as the week, 
before Christmas vacation and Valentine's Da*y, 
there may be schedule conflicts. But as a 
general ruje a child in. the CAI program should 
complete a lesson each day he/she is in school. 



The best motivating factpr seems to be teacher 
support. If the classroom teacher thinks that it 
is important that the child M go to the computer" 
each day, chances arc that the child will go. 
However, when £he teacher really doesn't care, the 
child tends to "forget" two or three times a week.- 
We feel that the attendance problem will be re- 
solved when a better system of informing teachers 
of CAI capabi litres and applications are developed. 
There is no woVkshop week previous to the dpening 
day of the school year in Sierra Vista- The 
teachers are* in school .only one day before the 
students return. Therefore the CAI orientation 
will need to be during the first week of school % 
A meeting in the computer room with jthe teachers 
of each grade while jheir classes are at "music or 
physical education (30 to ^5 minutes) should'be.. 
sufficient for a brief information session pl'us 
some "hands-on" time. The importance df teacher 
fol low-up wi 1 1 be stressed.' They will then be in 
a better position to decide if they wish to use . 
the CAI system as a teaching aid. It should be 
made clear that our CAI is in no way going to 
supplant .the teacher or be responsible for higher 
student/teacher ratios. It is a method of en- 
abling a student to have additional drill and 
practice in the specific areas in which he/she 
needs help/ 

A school system establishing a computer aid- 
ed instruction system must consider a number of 
, questions and make some rather difficult decisions. 
As always, costs will be an important component. 
First and foremost, it must be established that 
the CAI programs will meet the school's needs and 
that the CAI philosophy iscompatible with the 
school's traditional materials. Her.e, for once, 
cost should not be the ruling factor. An expen- 
sive program that meets your needs is probably 
worth the extra money. Next, it must be deter- 
mined that the^ associated documentation and support 
materials are adequate. Finally, flexibility and 
usefulness of .system generated reports should- be 
considered. The school system should insist that 
the software vendor provide continued consultation 
and expanded documentation as required. Schools 
which anticipate unusual requirements should consi- 
der contacting for custom modifications to standard 
software. I strongly recommend that only extremely 
prosperous and well qualified school systems 
attempt internal development of computer aided 
instruction programs. Development of all types of 
software is notoriously difficult and time consum- 
ing and can be staggeringly expensive* 

Once a £urr\fulum has been selected, atten- 
tion must be given to .hardware. The quickest and 
simplest solution is to contract for a package, as 
Sierra Vista Public Schools <Jid with CCC. Our 
vendor .provided a complete system, hardware, soft- 
ware^ maintenance support, and staff training^ 
Standard packages, however, are .never quite what 
the user would like. An experienced school system- 
might do well to tailor the hardware somewhat. The 
first choice is whether to use an exi sting, computer 
or to acquire a new machine to be dedicated to CAl« 
This is a very difficult question^ depending on a 
host of matters such as how easily the software can 
be adapted to the existing: computer. The decision 
should be made* by experts after careful study. If 
the experts aren' r t available or time doesn^t allow 
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a thorough ytudy, 
recommendation. . 



follow the software vendor's 



The other important hardware consideration is 
terminals. CA1 terminals is between a keyboard 
printer^ combination CHke a teletype) or a key- 
board cathode ray tule (CRT) combination. The CRT 
units have the advantages of being silent, not 
requiring paper, and being essentially nonmeehani- 
cal. Furthermore, they look something like tele- 
vision sets and may be more attractive to TV condi- 
tioned children. A considerable disadvantage is 
that no permanent record ("hard-copy") of the 
student's work is produced. Keyboard printer 
units, of course, produce hard-copy. Standard 
ASR-33 type units are very cheap and quite reliable. 
T[iey are somewhat noisy and require messy chores 
like changing paper and ink ribbons. Some of the 
mote expensive units, using thermal printer's, are 
fairly quiet and* don't need ribbons. While good "* 
cases can be made for almost any type of terminal* 
plain 33-type units are probably best to start 
with. Whatever type of terminal is selected, the • 
terminals should be located in a special room, 
apart from ordinary classrooms. This relieves 
the classroom teacher from the added responsibi- 
lity for the machine and makes for more efficient 
scheduling of terminal usage. 

Finally, maintenance must bp provided for all 
hardware. Again, a package agreement is simplest. 
In smaller centers like Sierra Vista, there may 
be no other way of obtaining qualified maintenance 
personnel. However maintenance is provided, in- 
sist that rapid response be a condition of the 
contract. v 

The size and type of staff required to admini- 
ster a CAI- program will, of course, vary from 
district to distric^. The amount of paperwork is 
large--remember thatT*±ie I is a federally funded 
grant program. , Therefore, We need a full time 
secretary. A CAI program funded, by a different 
method might^gpu A monitor*. is necessary at each 
terminal si&. Someone needs to handle changing 
paper and ribbons, reminding students of what to 
do next and fielding the little unexpected pro- 
bfems that always occur. In addition, our, moni- 
tors give the WRATs as children enter and leave 
the CAI system. Ther # e must be a person who is 
in chaVgeof the- CAI program'. If this should be 
his/her sole job* would depend on the si2e of the 
CAI system. ( ;0ur~Ti tl e " I Director is also a School^ 
psychologist and an adnini strator in charge of 
school nurses-, counselors and special education 
teachers, .inerefore, the math consultant serves 
as the a*cting CAI Oir<ictor although that Ms not 
• her title; Curriculum specialists wji$pld again 
depend on the size and extent of your CAI pro- . 
grdm. Ah advantage of sich special istf^is that > 
there is a central person to turn tp*with spe- 
cial problems. 4 If such a person is already \ 
available in your district, perhaps it would not 
be necessary to duplicate the position for the 
CAI program. In Sierra Vista we have a Title I 
psychologist who gives psychological evaluations 
to many of our CAI students. We have found this 
to be a very helpful and informative service. 
Adequate lines of. communication between CAI and 
existing school district staff are most impor- 
tant. Person-to-person communication with 



additional memoranda bn important points seem most 
effective. Principal and teacher orientation is 
most importanj and should be carefully planned. 
All teachers and administrators .should be included 
in this area. Student selection will be deter- 
mined by the purpose of your program. Our guide- 
lines were set yp by Title I. Perhaps' another 
CAI system would be geared toward the gifted child 
or made available for drill for alj students. 
Here it is necessary to have your objectives well 
in mind Ipefore student selection begins. Parents ^ 
should be strongly encouraged to become acquainted, 
with the program. The best method to Teach as j 
many persons as possible is to have both daytime , 
and evening opportunities to view the terminals. * 
Oata derived from the CAI system may provide in- j 
formation which could.be used to strengthen the , 
existing curriculum* irr the subject, school or 
district. There will be a wealth of material 
available; it should not be ignored. 

* 

In summary, Sierra Vista Public Schools., with 
federal financial help, has found that computer 
aided instruction is a valuable educational tool. 
A straightforward .program witrT modest goals has 
provided nearly 300 students with drill and 
encouragement not available in traditional environ- 
ments. As a bonus, the CAI support staff has been 
able to provide consultation and analysis services 
previously lacking. Successful CAI f we have 
found, -calls for, careful planning and program 
selection, followed by extensive orientation^ of ; 
teachers,* parents and participation of students. 
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FIGURE 1 The organiztion chart of Title I and other school personnel, 
Sierra Vista, Arizona. 
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2. The Computer Aided Instruction network in use at Sierra Vista. 
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NUMBER AND NAME; PLEASE: PC C C C C 

WHICH ROUTINE? STUDENT 

STUDENT NUMBER: 1222 

NAME: NORMAN CHESTNUT 

CLASS: 2-3 

CbURSE: R 

GRADE LEVEL : 3*5-40 
COURSE: M 

GRADE LEVEL: 10 38 
SESSION: 7 ; 

TIMEOUT: 30 
COURSE: 

STUDENT NUMBER: * . 

25 MAR 76 11: 12 i 



Figure 3* An example of a student enrollment* 
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NUMBER AND NAMEj PLEASE: REPORT 
REPORT TYPE CS/C/T)r C 
REPORT NUMBER: 12 
COURSE: X 

\ \ 



12 SYVASSINK 5 



25 MAR 76 
MATH 

ID# FIXED 
27+ VM36 



lit 14 



1 



SES TIME AVG NC HA HS *VA VS EQ MS HM LW VM DV FR DC NG 

76 1: 1 1< 20 20 20 20 20 20 20 20 ; 

DEBBIE BABUCA * • 

28+ UM36 75 li 18 at) 20 21 20 20 2fl 20 20 * 

DON KANAVAH * • 



25-.MAR 76 1 U If 1 

READING 

HRjMN TO BS WA VOC LC IC VS AVG 
1:2-6 1 4*0 4*0 4*0 4*0 4*0 4*0 



1:43 0 2*6 

1:38 1 3*5 3. 5 3*5 



25 MAR 76 11:15 
LANGUAGE STRANDS 
NUMBER A B C. D 



2*6 
3*5 3.5 



10 * 

2 ALEXANDRA LENTZ 

% 3 LARRY TOWNSEND 

• •'5 DANNY CHANDLER 



,E F G AVG \ HR:MN «" 



25 MAR 76 
TOPICS 

ID TCL TOPIC 1 



1 It l£. 
2 

REPORT TYPE (S/C/T): 
25 MAR 76* ° 1 It 16 



6 -i7 8 .AVG 



Figure 



An example of a Weekly Class,, fteport. 



Dumber and name* please: 1530 anjta feugate 5 
hello/ anita. ' ? 

25 MAR 76 11:23 ! 

COURSE* R 

* * *■ 

THE OLD MAN UIVES NEXT TO A CEMETERY. 

THE OLD MAN LIVES NEXT TO A . 

SCHOOL GRAVEYARD GARAGE 
GRAVEYARD 
• 

f 

THE FROG IS HOPPING DOWN THE STREET. THE FROG BELONGS TO RUDY. 
THE' FROG — DOWN\ THE STREET BELONGS TO RUDY. 

HOPPING \ * 



A BERRY THAT IS BLUE ISA . 

BLUEBERRY ELDERBERRY BLUEBIRD 
BLUEBIRD 

//// ■ THE ANSWER IS BLUEBERRY 

LINDA WAS LOOKING THE OTHER WAY. LINDA RAN INTO A tltAILBOX. 

THE OTHfeR WAY/ LINDA RAN INTO A MAILBOX. ' * . 

LOOKING * ' . 



THE 'GROCER MADE A MISTAKE AND jGAVE ME TOO MUCH CHANGE. 

THE GROCER MADE AN . 

. OCTOBER ERROR APPLE 
EROR : • 

//// THE ANSWER l'S ERROR 0 

A BODYGUARD IS A GUARD FOR SOMEONE'S . - 

BODY MONEY POODLE 

* * 

5 PROBLEMS WITH . 3 CORRECT. 60* 
CTRL-Z 



.COPYRIGHT CO 197£ COMPUTER CURRICULUM CORPORATION 
COURS£t * * i / v 

GOODBYE/ ANITA. , 

25 MAR 76 1 1 1 S5 m I % 

v 

Figure J. A sixth grade level reading lesson. t 
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NUMBER' AND^NAMEp PLEASE: 1515 JOELLEN FEUGATE 
HELLO/ JOELLEN* \. 

11:21 11 



\ 



HOV MANY A'S?» 



VIOW MANY A*S? 

AAA 5 
TRY AGAIN 



^OV MANY A'S? 
\AA AAA « 



AAA S 



Problems with 2 correct. 67* 



3 

* CTRL-fc 



COPYRIGHT <C> 1975 COMPUTE^ CURRJ CULUM CORPORATION 
COURSE: * 

goodbye/ JOELLEN* 

25 MAP[/76 111 22 



Figured. A first grade level mathematics lesson. 




AUTHOlhr(\lUJ.\(;i ^hinilllY: \N ANSKtR TO CURRICULUM I)h\ LLOPMENT 



* Paul lurnas 

Spcrrv Univac l.duc at mnn 1 Data Systems, St. Paul, MX 55165 



hUU : curriculum development lepresents a substantial step in the operational and 
hkmtuc costs of a CAI >y>tem. Sporry Univac directly addressed the problem by creat- 
<K a logical and simple Lngl ish-based' author language. The s -\uthor language ' 
i ideation and Training (ASM J uses several innovative techniques to make it 
cu>\.-to-use for the inexperienced t \I author and flexible and powerful for the exper- 
ienced author. The language transforms teachers and instructors into CAI authors 
fiom existing faculty without specialized pre-training in computers or programming. 



for 
both 



I nt roducj ion 

l v rom the moment of its birth \n the J 
1 USD's, Computer "Aided instruction I CAI) 
has promised great potential for progress 
in tins "key social activity. Somehow, 
realization of its potential fell short 
fit" the vision cast by the sum of its 
parts. One of the persistent roadblocks 
to full fruition has .been an loperat ional 
and economic one: curriculum development, 

Sperry .Univac d i rec t iy ' addressed 
this prablem in their new \uthor System 
for 1 ducat«on- and Training (ASi; D . As 
the name implies, A SET revolves around 
the. central ingredient in any -educa- 
tional- system, the curriculum author. 
\SFT begins with an 'author language- 
that transforms teachers and instructors 
ot 'existing faculty into authors with- 
out special i zed training in computers 
or programming. Sperry Univac achieved 
this breakthrough by builtfing into the 
■language a logical and simple, English- 
based syivtjax. ! : or example, the language 
contains a two level* structure: one 
for beg infers find a second command y • 
repertoire ivitJh a full, powerful CM 
structure for experienced authors that ( 
is an extension of the first level. 
The beginner's level enables a faculty 
member to render his or her specialty- 
into a complete Socratic dialog lesson 
suitable for present at iqji to a .student 
with just 5 commands. ' * 

A fcw words further explain the ft 
\SLT project group 1 / concept of simpli- 
city. Simplicity was not chosen as a 
kev desi*gn objective arbitrarily but" 
because of its impact on t*he human 
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factors engineering of the external: 
the author language. The exigencies of 
training users in a. higher level language 
soon teaches the basic premise that sim- 
plicity is the outstanding factor 4 hat 
one can select among several huluan factor 
features . Others inc lude congruenc > 
with existing language systems familiar 
ito the expected population of users, 
appropriateness in terminology to* the, I 
educational profession, minimization bF 
the explicit signals requi recr from the 
use|r to implement the functions fr^m ^ 
the system that, the user wants,, anil * - 
maximizing the number of functions' the*" 
system selects automatically by default 
to provide t tie option used by the high- 
est frequency user, capable of override 
in the unu'sual case. 

The following sections trace in 
greater detail the varied wjiys the con- 
cept of simplicity fhreads throughout 
thc.ASET System. These include*; 

1 ) II ierarch ial st ructure in two 
' levels for beginner and expe-rienced 
.user. Onjy 5 commnadi initiate the 
** . beginner, 

. 2)£hrtglish based / classroom oriented 
syrftax. 

3) Pi 1 1 - in: the-blanks organization 
for wesson development. 

4) Lesson structure analogous to 
writing, -textbooks. 

1 

5) Conversational d ia log .opt ion for^ 
lesson development. * 



HH2 



6) Auto^Vtod functions with author 
overrides • 

7) Transparency of computer imposed 
'constraints such as memory alloca- 
tion, word size, etc.* . 

8) User oriented documentation. 
Two Level Hierarchial Structure- 




The difficult aspect of learning^* 
language is the problem of getting , star £*<d. 
Once started/ each level learned becomes 
a -springboard to the next and more ad- 
vanced level. ASET solved the initial 
inertia piroblem by designing the complete 
system with the basic simplicity that ah, 
author could begin with a knowledge of 
no more than three commands. With these : 
three commands/ an author's usual writh- 
ing 'skills/ and a simple pre-printed 
form; the. author renders his or her spec- 
ialty into a complete Socratic dialog* 
that will appear on the student's termi- 
nal. The three commands are: * 

'«* 

IF 

/ . • PRINT 
♦ GOTO 

m 

These three selected commands are the 
bapkbone of all the ASET commands and 
are powerful enough in themselves .to 
guarantee the author a simple but ade- 
quate lesson on! hi? or her first att- 
' empt . The , three commands ^a'ccompl i sh 
one basiC'CAI cycle:, presentation of 
* concept or information rto be learned/ „ 
statemen: of question to, test student's 
perception of concept/ evaluation of 
student's response, 'and the supply of 
reinforcement K to the student (negative 
if incorrect ana! positive if success- 
ful) > and direction to the next logi- 
cal step in the .learning sequence 
depending on the results of the eval- 
uation, of the students' response. % 

> .The IF command instructs the com- 
.puter to evaluate the* student 's res- 
ponse to the author's testing of the 
student's ^perception. In ASET the ^ 
author need not command the computer's 
display pf the author's concept/ the* 
related question in^the Socratic style, • 
nor the reception of the student's 
answer. These operations are, all 
performed automatically by the computer 
without author command. The author's 
IF statement sets up the criteria, 
for acceptance or rejection of. the 
studdnt's answer. s ■ » . ^ * [ * 

The PRINT command allows the 
author to reinforce the response by 
the student. .The author provides two 
PRINT commands for each CA^-cycle at 
least/ one if the answer i/s/fche answer 
^-anticipated and one for a^lncrirxfect 



\ 

response, fn ^SET/ the author may even »r 
have these two commands automated for him 
or her and allow the, computer to reinforce 
the student's, answer without _any explicit 
instructions". ' " 

/■..,: • . . < " . 

.Final lX/ .the GO TO command allows the 
author to individualize his or her instruc- 
tion by directing the*£ low of the lesson 
tUjTone of any number "of alternative next , 
steps in 'the lesson according to how the 
author sees* the instructional needs pf 
this, particular student. In ot^er words, 
if the student nee,3s some practice before 
tft e student attempts the question again/ 
^Ifie GO TO commands request, the necessary ' 
sequence from the computer. If^ the 
author juxJges that a certain ^response 
requires remedial or supplementary' instruc- 
tion/ a GO TO command directs fche lesson 
flow accordingly. . The GO TO commands ( 
determine the path that A student 'takes • 
as he or she proceeds through a lesson. 
Each, student proceeds through* the lesson 
in a' unique manner. When Executed by 
the computer/ the GO to command directs 
the s.tudent to the. moste efficient and * 
effective learning for that student. 

T,he GO TO command also provides two < 
paths from each question,. If the stu- 
dent answers the* question correctly/ the 
author provides* a GO TO command bhat * t 

branches the student to the next . un *£ • - 
'within the lessdn sequence. The correct 
response path or ' prime K 'path/ « provides ' 
the ^most direct route through a lesson. ^ 
. if a student answers incorrectly/ 
author provides a second GO TO that 
branches the student backwards to re- 
peat parjb of the lesson or to execute 
a remedial sequence* t « j * ' I 

In summary/ .the* GO TO commands enable 

* t^e author to control the flow of the - , 
"lesson. Occassional uses branch a stu- 

\ dent to, practice,* sessions/ pre-test 
exams / and filial examination. 

* English kased. Classroom Oriented Syntax 

Any higher level language must satis- 
fy the needs of the computer for precise- . 
* ne&s and .direction. The temptation or 

tendency, is that the language becomes 
, more oriented inward to the realities^ of 
„ such computer operations or character! s- f 
tics as word size/ registers/ memory . 
'allocation, memory addressing/ and * 
memory transfer., ASET avoids these ten- 
*<3encies./ ASET looks outward to the 
author user and couches .its terminology *- 
in* terms of a .language system familiar 
tp the classroom teacher., * t 

/ ' "* Ah alphabetical list, of* commands 
demonstrates bptV the simplicity of the 
language and its. basic English language 
.'system orienta'tion: * 
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i answer// 

/ AUTO- // ' 
BACK f 

DELETE 

CO , 

END SESSION 

£RASE 
~j EXIT 
* EftD HELP 



HElA> ' „ 
PROJECT 
RESPONSE TlkE 
RETRY 

RETURN- * ' < 
SET ' , % 
SKIP 
TAB 

UPPER • 
RANSOM " « 



T^e options/ selected by 
a similar character:, 

#\ 

COMMENT <&N r 
AN S WE ft ON 
BACK ON 
RESPONSE T£ME 
UPPER ON 
\UTO NO ON 
^AUTQ YES ON 
STRY \. ' 



an author snow 




SESSION TIME 
ITEM A^ALYSI,S 
PHONETIC ON • 
FORMAT 

microfiche 
author' 

ARRAYS 

ANTICIPATED RESPONSES 



< 



bameter* strings associated w^th 
xmands and. options, show a cofres- 
ng attention to sims&i^ity. Most 
limited to no more than? one para-,, 
meter. The parameters consist of OFI* 
on ON,, an integer number, or, .'a simple • ^ 
labels J * K * • * • • 

* * 

Fill-In-Trielfoanks Structure . 

Each Sbcra£ic dialog cycle ir\ the 
AS£T system *3dnsist si of A <a framework of 
three elements. The tlpee elements f ^ \ 
appear explicity#on a line by themselves 
in *each lesson unit; * thus , serve; # as \ 
prompts *to the author* When the. author x 
ha* filled £ri the th£ee elements^*all of , 
the required elements of conceptrjyesen- \ 
tation, follow-up question, response * 
evaluation, reirtf qrcement, a*nd guidance 
teethe next logical -step needed *f or one. 
teompleted*Maie^itic*cycde *dre. present. 

0 » 

The three elements are: * +* \ 
4*. • * * . * ** 

Initial* text - ■ 

COMMANDS, " . ' *\ V 

, s^P&Q '(reinforcement message) 

. * %~ , 

The "Initial- text may be- from 1 to ,12 
lines "in fref fqrm of the author ;s 
choice. Tne COMMANDS element consists- 
f of strings of commands the autnbr sel~ J 
ectajfrom trie list of available commands 
JtojR?ntrol ljesson flow, to handle s£u- * 



dei it | res pons 
thet student : 
variables, t 



exercise of optional activity, to re- 



st* rt, to se 
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s, to delete portions of 
esponse, to manipulate ^ 
>,give or withhold student 



*be kept, and 
N t ; u student 
a LI of the r< i 
.aithor antic: 
pfditive 



inert 

If 



.bet amounts of records* to 
to evaluate responses by 
The VEXT ele/nent contains 
infbrclng .replies the 
pates, both negative and 
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TYie fill-in-thei-blanks character of 
the basic lesson unit structure, besides 
having the" virtue of assisting beginning 
authors, also ensures that experienced 
authors consistently tike advantage tof 
the potentials of sound CAI principles 
»of instruction. f 

Analogies to Writing Textbooks - ^ 

In the final analysis, €he. writing of 
an ASET lesson looks to the prospective 
author .as* a task that is very "similar to 
writing a; conventional text book. In a 
faculty that contemplates extending" their 
eduoational offerings to CAI or enriching 
their existing curriculum with CAlv the 
likely candidates for authors -are those 
who have already written textbooks or are 
likely to. 

A paragraph of a conventional text>- 
book looks very much like the initial 
text of a* t ASET lesson.' The question a 
textbook author would locate at the end 
of a chapter or in a section on -exercises 
at the "end of tnfc textbook J is located 
immediately following the presentation 
of the'eoncept or fact in the ASET lesson 

-A set of \ASET urfits combine ,"€6 form 
•an ASET lesson analogous to a chapter in 
a* conventional textbook. A setj of les- 
sons go together to make an ASET* course ? 
completing the analogy to the convention- 
al course textbook. * t v 
• ■ 

N The textbook author develops |f he * t 
teohnique of identifyihg , and "communicat 
ing a, subject in his or" ner area ol 
ialization in terms df readily explain 
' able discrete steps. Thfs sa(me skill 
readily transferable t6 .segmentation 
the ^autho^s ^ubj^ct irrrto> the basic 
units. of an A£ET lesson, , a "cyCle o^ 
Maieutic .dialog. "The "combination # of j 
several units fits naturally into*^oth 
an author *'s feel for the flow of his-\ 
subject and the flow of the computer's 
execution of an ASET Tesson. 

Development of Lessons Through cfenver* - 
sational Dialog . * 



•qua si ve pract 
5ocratic methocTftaa *Uitf effect of jalert- 
ig those who work with it of the fre- 
ent s opportunities to use it in .contexts 
ther than the conventional teacher- 
stuflent dialog. Such an opportunity 
aecafne very obvious early in the ASEJ 
project effort. The idea was to .use* the 
nethott 'to assist new authors in the use 
Df ASpr^ The result was a conversational 
node # that an author could use toicreate 
in ASETr lesson. 

The Conversational M^Tdje proceeds by* 
displaying* a series of questions on the 
•author Is terminal. The, aithor types in 
anijwetfs,* to the questions on tne 

i. *>" # * S ' 




\ 



arte^the-system 



.terminal* keyboard aito^tbe-aystera does the 
rest. The qdeations*i*V simple and^ brief . 
so thai, they can also serve as prompts 
for .further lessons after the authors 
first* * Besides the feature of teaching 
a prospective authop^the use of ASET, * 
the Conversational ftode has the advan- 
tage of methodically ensuring thait. the ' 
potentials of the GAI approach to'learn-, m 
ing are built into the* author 1 s lesson. 

; * To illustrate the simplicity and 1 
brevity as a constructive adjunct to sys- 
tem design, the following are the Conver- 
sational Mode prompts. They also give 

a .larger sense the author^ progressive 
development of an ASE^E lesson. ^ 

. LESSON OPTIONS? 

# RETRIES ALLOWED: / . * 
RESPONSE TIME (SEC) 
SESSION TIME (MIN) 
ALLOW CALC? * 4 

* ALLOW COMMENT? 

ALLOW ANSWER? * * 
**UNIT LABEL: 
UflIT OPTIONS? 

# RETRIES ALLOWED: 
RESPONSE TIME (SEC) 
TEXT:" - 
QUESTION: 

ITEM ANALYSIS? 
ANTICIPATED RESPONSE: 
ANALYSIS TYPE: / , 
4 TOLERANCE ALLOWED: 

REPLY: 
BRANCH: 

REPLY TO UNEXPECTED ANSWER: 
BfcANCH: * 
EDITING? r % 

DISPLAY SYNTAX?" 
OK? 

BUILD UNIT? 

ASSEMBLE LESSON? « 

LISTING? . % ' ' 

S^AE FILE, ELEMENT NAMES? . 

FILE, ELEMENT NAME: 

* 

e 9 Readers may see that the following 
prompts from the above .set represent one > 
cycle *of a^Socratic dialog: 

TEXT: 
QUESTION: 
* * ANTICIPATED RESPONSE: 

ANALYSIS' TYPE : 

TOLERANCE ALLOWED:, * . 
« RffrLY:- 
BRANCH: 
• REPLY TO 

r » BRANCH: 



EXPECTED ANSWER* 



■ - J ' ' 

!Phe prompts related tjo a cycle Re- 
peat/ reiterativelyiuhtil !the auithor con- 
-iThe last eighH prompts 
Eesson, 



eludes a vN les son. 



allow thp author to review the 
make»any changes desired J and tg specify 
•the' doctimerjtatton for the! authojys record. 
Tinally, the .system automatically supplies 
hil the comma's that th<[ authors answers 
to the prompts ^ha^ implied, A^ can be 



seen; to develop a* ^lesson using the Con- 
versational Mode 'requires no speciallze'd 
computer knowledge at/ali, not even the 
three basic ASET commands noted earlier 
a$ the minimum needed. The author only- 
needs, ^he usual skills of written commun-. 
ication ana the knowledge of the author's 
area of specialization. 

v ' . 

Automated Functions with Author Overrides 

As a deliberate objective of design, 
policy, ttte A3ET System minimizes the • 
, number of explicit signals required from 

* the user to implement the functions the 
user wants. To .give this amount of 
automation to the author and still give. 
£he author control, the automatic func- 

% ^ rpPbions are generally accompanied by an 
override for the exceptional case. ,The 
high frequency options execute automati- 
cally; the less frequent option requires 
the explicit commah$, directive, or, • 
' parameter. This approach assists the 
begiriher author particularly. As. the 
*' author gains experience 1 with the system, 
f he or she may call -on more and more of 
, ' the customizing power o£ -selecting 

opti6ns that meet the specialized needs 
of the author's own concept. 

- A few*examplps give t lis thrust of 
how this, design* goal effected the ease 
of' use of the\ASET Systerp: ** 

1) initial text**and authbr's follow^ 
up question do not require commands 
for thefir display to the 'student. 

" C *2) The reception of the student* s, , 
answer, its processing, and the con- 
.t * trol of* the frame advance are all 
> performed automatically withqut ' 

^ specification by the a^uthorv. All . 

\ ■ Computer buf f ers', memory allocation", 
»* memory addressing, register setting, 
word sizes, etc., are all trans-* 
paieht to the user ±n the lapuW 
output required, by the sequetyce^ of 

* computer events. v ^ 

4 x 3) The system automatically .initiates^ 
% 9 . the next lesson unit^ iti the Wesson 

sequence unless the. author specifies 
otherwise', 5 / 

\' . * * 

* 4) if the' author does no1 specify a 
' parameter; the systep sel s antaver- 

age value £n default. F< r. example,, 
the system s 1 ets the limil for a 
student to respond to a < uestiop at# ~ 
90t seconds, an average vj lue* «lf . 
is not satisfactory to the / 
or, he or she may sp< c^f y -any . 

from lO seconds to 999 .seconds. ✓ 

The system *iutomatlca4.1y sends a 1 t 
message. to tjhe student wheit the time 
limit expires. ' j 




/. 
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5) The author may specify functions 
for the lesson as a wnole. rather 
than reiterate them for each unit, 
- Tor -exceptions the author may specify 
an override command <Jn a unit-by-unit 
basis* For example, the author may 
specify the number of allowable retry 
^ attempts to answer a question. The 
* author specifies 'this once in a* 

Header Directive rather than as many* 
as 512 times if this is trie number 
of units in the lesson; • , 

• 6) An author may initiate a full 
record keeping and report generation 
system with only two steps: selecting 
the type and amounts of records to be 
kept on-line while the student takes 
the lesson and the content and extent 
of analyzation of the data from these 
records for the final report. 

7) * The system automatically erases/ % 
the Information left over from the 
previous lessoq^unit before display- 
ing the*initial text for a new Jssson 
unit, tfhe author may override this 
feature if the circumstances require 
it. 

8) The system automatically processes 
most student key -ins on the terminal 
keyboard of an administrative nature. 
The author is relieved of providing 
allowance for this type of eventual- 
ity. \ 

9) Some services that a computer can 
uniquely provide are available that 
would take- .a great deal of ingenuity 

- ' on the author 1 s part dnd/hours of , 
time. m An example is a random number 
t generator. Another example is a 
* phonetic match generator. , 

Transparency of Computer X-mposed 

Restraints , . . * " 

" ~ % " * *» . • : 

• *The ASET author's, language is con- 
rijruejnt, not with computer science langi- ' 

uage systems* but with, an English based 
language system. A goocl example of 
this orientation is the absence of any 
computer imposed limitations *in the 
expressions that the author uses. The v 
ittner wordings of the system apdomodate 
aptl of these restrictions such that the* 
author ii domjjletely .unaware of them; 
iii otherJ words they, are transjjarunt to 
/the authors \ ' 



examples include: 



< : 



Word size 
Byte size 
„ n Input-output buffers 

4) Memory allocation 

5) Memory addressing 

6) Ifemory medium 
(core, *disk, tape) 



^ 85 



7) Register assignment 

8) Register saves 

9) Character mappin< 

All of the a^ove are set or manipu- 
lated on a common sense basis of ex- 
pected average values, adjusted by 
operating experience, Vith provision 
for overflow when needed. % * 
\ 

User Oriented Documentation 

Much software (Jotfumentation is 
written* from the viewpoint located at 
the center of the system looking, out- 
ward. For example, the principle sub- 
divisions of the software system become 
the principle subsections of the user»s 
guide. The ASKT user's documentation" 
is written from the viewpoint of the 
user looking in from the outside of the 
system. For example* the principle sub T 
sections of* the** user^s guide are the 
questions in the. user % s mind as they 
occur tso the user in a logical order 
to accomplish the CAI function. The 
subsections become a step-by-step 
guide for writinq a lesson. 

' Another example of user orientation 
of the documentation is the continual 
visual correlation maintained between 
what the author writes in the fill-in- 
the-blanks development of the lesson 
'and what the student sees as a rosult. 
Complete examples exist with graphics 
that in a sequence of frames show a • 
complete lesson in a cinematic style. 

The ASET documentation gives fe-" 
'plated overviews or summaries of the 
author language. In effect, an author 
"'can take short cpiurses-^pr review the 
language* in two or three pages. Fre- \ 
quent -tables orgahi^e the r^levantc 
information in'sych a- why that an author 
may detach .thera^f rom the parent document 
and keep them-^or handy fcefetence. 
A pocket oui'de, of shirt of vest pocket 
dimensions, s&rves as a reminder'pf 
tn0- details o:: the system for the' 

rienced author that he or she can 
taTte to**the computer console or terminal 
for\ convenient, <juick look-ups when 
functioning on-lfne yith the system. 

Co nclusions 



The simplicity of the ASET Author 
Lajkguage-^is deceptive. Behind a simple- 
to-use, clas&room-orlentec3> external 
design there* beats a very powerful tool 
fo:: the* Utilization of recent "jaiscoveries 
into' the science of the process df 
learning. {The 20th Century witnessed , 
a rigorous application of the search- 
light of the experimental method to 
learning theory. Bid.lt into the *ASET j 
system balled into play by this terse, 
direct language, 'lies many of the fruits 
of this innovative research^ Examples are: 



HHfe 



1) ASET automates the positive rein- 
forcement requirement postulated by 
B. F. Skinner aj3 a key inqredient in , 
learning,, j Reinforcement is indivi- 
dualized immediately and order syn- p 
chronized with each student* s attempt 
to learn* 

2) ASET realizes/ in practice/ the 
time constraints for association 
through the simultaneity of stim-^ 
ulus and response as measured 

'Pavlov and Galton. The quicker the s 
reply^ the stronger the association. 

3) ASET established rewards that are 
contingent on the behavior desired " , 
as proposed by Bloom. * 

4) ASET improves learhing rates by 
incorporating active student parti- 1 
cipation as .correlated by Witasek 
and Gates. 

5) , ASET gives an author the oppor- 
tunity to repeat student practice 
based on correct' ^responses rather, 
than incorrect oneST/ a strategy 1 
suggested by Ebbinghouse. , * 

6) ASET ensures a pre-planned/ < 
uninterrupted implementation of 
Bloom' S/ Krathwohl'S/ Simpson 1 s, 
and/or Gagne's taxonomic behavioral 
objectives at each* step in the 
instruction. 

7) ASET includes a large proportion 
of psychomotor taxonomies as sug- 
gested by Simpson by the student 
muscular responses required to 
operate the terminal keyboard. 

8) ASET .multiplies the number of 
different individual skills/ apti^ 
tudes/ and experience or students 
that can be anticipated with a 
separate response to each. ASET 
accomodates all oh -an individual 
basis even though, any one stu- 
dent takes* only one branch. 

9) *ASET's flexibility provides new 
opportunities to contiguously pre- 
sent a concept/ all operant, rules 
ab$ut that concept/ concrete j 
examples, and ^exami nation as a 
strategy ta enhance learning' 
through discover^ techniques as 
proposed by Gagne^ 



arrangement of learning materials . 
such that the frequencies of posi- / 
tive reinforcement are maximized / 
* and the frequencies of negative 
reinforcement are minimized* / - 

12) ASET avoids t^ie* inefficiencies 
. of overlearning and minimizes for- 

5 getting stimuli as defined by 
i / Ebbinghouse* 

13) In ASET/ learning progresses by 
developing the performance skill of 
overlapping operations ,in increasing 
order of complexity so that the * i 
total requires less time as suggested 
by Cattell. 

,14) ASET emphasizes the internali- 
zation of inner growth as the 
ultimate objective pf education/ 
the operant learning ;,as Skinnen 
theorized. * \ t <4 \ « 

The educational innovations" made by 
ASET/ £nd the skill of the author'/ Acorn-' 
bine to provide the potential for stu- 
dents to learti faster and achieve higher 
test scores than they might 'achieve by 
conventional instruction. ASET offers 
new thresholds for building quality into 
educational programs, quality in terms 
of the enhanced skills of the students ( 
trained. 
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10) ASET lessons incorporates both 
the linear program method of Skinner 
and the variable program of Crowder*. 
The author is free to select one 

or both for' the learning method 
appropriate to the learning objec- 
tive. 

, ■ 

11) ASET increases student motiva- 
tion through the deliberate 
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ABSTRACT: 



What is Discourse^ftnalysis? * . / 

Who does it? 

How is £t done? * 
What will Discourse Analysis do for CAI? 

In answering the above questions, fills presentation,wl]<>J. provide 
an introduction to discourse analytic techniques for Natural language. 
Computer scientists, linguists, aijd literary scholars are. all very 
much involved in research which has both short-term and long-t-erm 
implications for the teaching of English and other natural languages 
through computer-aided instruction in educational instruction. 
Highlights of current research and its relevance for CAI will be 
* stre'ssed. m > 
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me has come when, the qual 
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thought. Hardware experts lead the thinking, and teachers 
rather than for the best educational meth< 
made for more control on quality, and a few possibilities 
demonstrated 



must be given serious 
;end to write for thre hard- 
iology. Gome* proposals are 
>f first-language training are 



It, has become apparent to- me, over the years, that cimputeriz^ education has be- 
come, unintentionally perhaps, -a by-product ^of the computerization ^>f education. 

Computers wer.e used for educational administrative purposes before the possibility 
of their being applied to educational processes was "realised. The hardware, then, 
existed, and the demand that came to be heard was "Where's the courseware?" Teacherr 
bcfan to comply. >^ , , » ■ * 

But many teachers found t,hey were in opposition to, rather than in co-operation 
with, the hardware experts.- I was challenged: "What I want to know is,; what can your 
nrograms do for my computers?" » 

■?he enormity of such illogicality,- from intelligent people is so mind-boggling that 
, am afraid 'that on that occasion I lost the opportunity to make a suitable riposte. 

An institution "for studies in education" is on record as saying that it discour- 
sed* the planning of software that could not -be- used on existing hardware. It is not 
difficult to see the problems of an infant many regarded (and mai% still do regard) as 'i 
bastard, if it could not show that it had a right to existence. But "one can see also 
the long-term implications, fojr educational Software. 

A leader in research into *t he educational computer field told me^that he had no 
philosophical ;concenr for education: that was ufl to the academics. -His particular 
approach to learning was so f far ahead of 'much, academic thinking that one can Only shed 
a tear for the loss to education. ; * t T * , * 

Kurther, he held so unswervingly to his tenets that hundreds of teachers were riven 
the opportunity to computerize bad teaching. One recognises that* such an approach 
avoids the* confrontations .tha|t would be so tiresome and so ^dangerous. 

But surely the time has" cctae to challenge what is beiijg allowed on to the computer. 
We-are tired of seeing the same brilliant programs by the same brilliant teachers. , It 
is time to looki at all the.ottfers, and "to recognise that there has to be some kind of 
'control over the quality o£ programs, to acknowledge, despite all thg theoAes, that 
some methods, some approaches,, work better than others, and that quite simply, some do 
not work. ^Computerized education has grown up .but has not yet matured. It is .time, in 
the i^eifests of our students - all students - to' challenge, to confront. It is time 
to challenge the teachers - to challenge them to use the computer as the best of all 
learning tools, and not«as just another visual aid - and it is time to* challenge the 
hardware, experts to produce hardware that^will enable* the student to learn in an en- 
vironment that he cannot obtain in any other way; the terminal should, create the educa- 
tional environment. It A should no longer be acceptable that software succumb to^existing 
hardware, resulting so. often in blinH^red thinking t and eventually in another deadening 
process for the learner. * . , j % 

The need is for courseware that teaches as no teacher can, and for hardware. that 
% can enabled courseware to teach as no teacher can. * t | 

There have been,. 1 suggest, too many unwanted births, and there may have been too 
many abortions.* ' ^ 



If the possibilities are greater than any teacher, .however brilliant,, the dangers 
are also greater than* the danger posed by any teacher, .however dangerous. One of the 
most dangerous of teachers, if not necessarily the mosf dangerous, isthe one who,* 
wittingly or unwittingly, attempts to produce tEJKking 



Am I proposing the setting-up of 
even if it were to be myself •-' 1 erhap; 
it seems to me, has an opportunity to 



some educational 



and acting copies of himself. 

dictator? Resoundingly no; Aqt^ 
especially if i£ were, to be myself.' Education, 
become thfe servant of the learner in a way that, 
to the best of my knowledge, it never'has been. The master has, in more senses than 
one, been the schoolmaster. But I am not railing at the grossly overworked and usually 
grdssly underpaid teacher (overworked and underpaid if he attempts to handle \tis job 
, witn any seriousness and professionalism). He has been attempting to do an impossible 
task. For,the first time - and here is the answer to that glib line "There is nothing 
new in education" - it is possible to/ help every individual student; it is possible not 
only to tend his needs, but to help nim overcome his problems. We can be free at last 
of that psychological trap - "the class". 

But how are we to respond? " 

One of the most exciting educational experiments I have taken part in was team 
teaching. Team teaching has everything - almost. - It can cross the boundaries of 
adafteraic subjects, and show how related many disciplines are (surely o process long 
overdue); it makes u$e of a variety of minds and expertise, and not necessarily of one 
person per discipline (unless you organise it that way); it can and should use a multi- 
media approach: and with several people combining in a team, it has the chance of some 
•professional critical input, which thej teacher in the classroom rarely has an opnortu- 
nity of receiving, even if he wants it. We can have all that, and the individual stu- 
dent catered foe , / / "* 

It is a team approach that should enable us to become aware of our^ owp problems as 
teachers, to alert us perhaps io a better, approach, to question our^ occasional intel- 
lectual flabbin.ess, even at ticies to question our grasp ot our own material or even 
subject. Above* all, it enables us as teachers td continue to leapft,.\ 

But such tyiwteaching involves enormous effort and vast amounts* of preparation 
time. Television has made even out of the youngest pupils ve^ sdpnisticated critics 
(at least to the point of expecting the slickness of a good production).. It involves, 
also the timetabling necessary to prepare as a team and to teach as a teaau As a 
result, after one such experiment it t6nds to remain an experiment - however successful 
it was. 

I am convinced that the cross-discipline team approach is just round the corner for 
computerized education. Once the work is done it is done, and it is always available 
<which is not to say it can ! t be updated). But such an approach will make great demands 
on hardware. t t 

Meanwhile, I m working with a team that is not multidisciplinary, "but is attempt- 
ing to cope with learning in that most important of disciplines - communications. ^ A 
student's success* in all his studies depends. on the development of his communications 
skills; as does his own personal development. 

* The demands .being made oh people are showing up their "weaknesses" in communica- 

tions skills that were not apparent before .because they were not needed. What was 
functional literacy and oracy is no longer *so. \, 

As teabhers, .we know that our aim must be to place the student^ in a position where 
he is less and less reliant on us, and more and 'more reliant on his own ability. But 
the methods used to achieve functional oracy and literacy, at any level, are important. 
Methodology has, in some quarters, become a, dirty woxd; but it is Vital th^t we use re- 
search findings and our experience in .learning/teaching to produce courseware that does" 
what w6 claim we are trying to do. • * 

Research indicates .that, most adults ^assume that ;they are able to read, but in fact 
they faii to understand what the authpr is saying to 'them: their own opinions^ con- 
stantly g^t in the way* and the author is credited with views for which there is no t 
supporting evidence. Somewhat surprisingly, this applies also toi well-educated adults. 

We are building a course of computerized" Englilsh language training that includes 
all the skills of communication - listening, speaking, reading, writing, and thinking ♦ 

ye see them as interdependent skills, and the student is helped to understand aAd 
to perform, .He learns through the process how to^l^arn*, "and I stress that it is^a 
^process that' he is undergoing, - - % 

We believe that a stUdenl f |S growth must be rooted in his*' experience, and we attempt 
to involve the student both 11 tellectually*and emotionally, and to mov* him to 'intui- 
tions and ponceptualising, j6 make imaginative projections, to read not only between the 



students are taken out of the class and they 
a dialogue en^pes between them. and the 
as a whole meets' the team and discusses the 
that also is tape-recorded. 



lines but beyond # the lines. f ^ 

One of the 'most important principles of teaching, and^ the least possible under nor 
mal classroom conditions, immediate feedback, is given in such a way that the student 
is not only made fully aware of what he says but is] helped to arrive at an acceptable . 
answei. -"Right" ariswers, incidentally, are^not what is jbost important. What xs toost . 
* nporljant is the process the studpnt is engaged in^ / ' 

The task of building programs of this kind forces tis continually to define and 
redefine what good teaching- is, and vhat the aims of education should be. Obviously, 
^e.are led to question our own teaching - a painful Jj^tj necessary process. 
' -I would like to discuss briefly the approach. We see language training -as being 
not a handling of problems of rex edi'al work, but essentially as developmental. We 
isolate an area in this process, 2nd discuss how it is best handled i.e., how it can be 
best taught - how is it best learnt. If it is' decided to use written material we search 
for something suitable. * i 

The questions we pose on the mat erial^C incidentally, as will be seen, questioning 
on the" material is only a part of the prace.ss'> are validated by a* class at the ^evel fo- 
which the material is chosen.^ Two or three 
answer, individually, the questions orally 
teacher, which is tape-recorded^ The class 
passage, tfte question^ and the answers, and 

With this experience, the. team decides to drop some questions, 'introduce others, t 
"and ai*$r the wording in some (.where it can. be seen the wording - not the concept - is 
at faul^K \ . s , 1 

The validation process is gQn§ through again with a different class at the sane 
level. And so on until -we^are sure the material is doing the job we want it to, ai^d our 
questions are hanging the aspects of communication we want them to, and are also han- 
dling the problems the students Ijave revealed. 

'The written answers are carefully sifted into Acceptable Answers, Partially Accep- 
table Answers., and Not Acceptable ^nswers. The answers in the last two categories ire 
then examined for patterns. 1 „ , 

We 'are ready t tp. start writing bur 'algorithms for the computer. The patterns of 
answers do, of course', give us our , branching (we add extras to cover logical possibili- 
ties and to cover any other not -acceptable answer) , and the tape-recorded sessions are 
a considerable help here, especially the one r to-rone teaching which gives $s the neces- 
sary break-down for individual teaching. 

Some of the students 1 problems Surprised us as, for instance, when we dis- 1 
covered that they did not understand ryot" to be a qualification of a previous state- 
ment rather than a continuation. When we followed this up we were told by high school 
teachers that a majority had, real difficulty ^differentiating between "and" and but . 

One process at* the terminal is as\ follows: the student is given the passage and 

" ' jie is satisfied that ■ 
recording(s). In our , 
indi- 



is asked to read it out lbud on tape ak often as he likes, until 
that 4-s jthe best he can db. He can,, of course, listen to his own 
experience, students ' work very hard at this.: When he is ready to -proceed, he so 
cates and we play him a recording made oy oujbselves. We stress that 4 this is a reading, 



not the reading. He listens to our recording, and then re-listens to 
^JmpingT He can re-record and listen to\any/part of the whole as he w:.shes 



The questions are put to him when he ik ready, and he engages in 



his own final 



a dialogue 'on^ 



questions and answers. He is not 

finally he takes part in 
^Jrike/'The master tape 
■ be read like this • 
vocabulary, stress, rl 

We find a studea 
lihlTfaar is a vital p£ 



only expected to have^ a response, but to articulate it 

seminar. , It is unusual for someone not. to say something 
read such-and-such ajp^rt like this .k I still think it should 
At once one is into the, uhoie process~o£ meaning - context, 
hmic patterns, grammar ^ syntax , punctuation-. 

with n mind's ear, as opposed to a mind's eye, a irarity 
of language training. ■ * « • / 



Ax^l 



We> are engaged ilji research' to use, along -with a CRT. or t teletype, 



a/ random-access 
t/ouch panels 



-audio disc, a oassette tapetftacorder, a voice-intonation print-out, a wuw; ^ 
Super-8 movie film, 35 mm. sfides, and a$ interactive graphic terminal (3-J> capability;. 

' But at all times our concern is' with what is the best possible way of teaching that 
I particular stage; northing is used because it is there. And if it isn't there and we 
I tipjik we need it, we 'take steps to'probe th,e$possibilitiee... _ ' — 

^ 1 --^ — to learn through in/terest. If he finds his 

' |is prepared to*ta<fkle hislproblem, even if it 



We finc^that students are motivate 
ierstanding is blocked by a problem, 



i£ one of grammar. It* is, of course, only when we fail to understand that we need tfo 
examine the symbols and the structures. j j 

Perhaps I can illustrate parts of the process with a passage from " Or I 1 11 Dresj 
You. in Ko^^7nnF; , , a biography .of El Cordobess the Spanish torero.. The passageis a:i 
exercise in implication. Apart from the factual information given,, the reader is' con- 
stantly being asked to anticipate - something an alert reader, and any listener, does 
by habit. It 'is, of cdurse, good habits that we should be trying to help the studerib 
acquire. f 

Las Ventas, as it had beer. for. foments, was a roaring cavern 
of noise. Yet, in that wildly howling mob, a sense of concern 
1 '* began to rise in a £ew seasoned minds. 

1 Trying to accomplish the impossible feat licking the paper 

of one of his han^felled- cigarettes without taking his eyes from 
the man in the cer^Fr of the ring, Don Juan Espfhosa JCarmona, the 
chaplain of the buliring, had the same thought. For several mo- 
ments his anxious mind had turned over* a nonstop invocation to the 
- . Virgin for t£e impetuous youth who *had this' afternoon stirred his 
' feelings as^no matador had done for two decades. 

v 'Thirty ranks below him, unnoticed in the yelling crowd, a man 
slipped from a stool pet alongside the rim of the 'call e,jor.. While 
. c the crowd went 6rasy, Dr. Maximo de la Torre hobbled anxiously to- 

ward his infirmary. I 

Their^, however, were only a few warning voices in a sea v of 
exultation. All Las Ventas, it seemed, was on its feet yellinfi, * 
shouting. So was half of Spain, pulled into bullring by a 
television, cable.' Caf6s, bars and restaurants all over the 
oountry were in a pandemonium. Everywhere - in clubs, schools, 
stores, homes - people pushed. and shoved, fighting for a glimpse 
of the screen, demanding, "What's he doing? What's he doinr?" 
v% Those instants were the fulfillment of everything El Cordobes * » 

had ever wanted, the solace for' every beating he had ever taken,/ 
the balra for every hunger pain he had ever known* He was, in the 
center of that bullring, the very quintessence of a "somebody," 
Twenty million people were calling his name, and 'yet he - he y 
was alone in a world of his own with a b\ill Spinning arouftd him. 

[After passage had been read, tape-recording played] * * 

* I. 
The first question we ask, is "What is Las V«ntas?" and the second is "now do you 
know?" This is part of a dialogue that ensued between the computer and a student. 



Conputeru What* is Las Veritas? ■ 

Student: Las Vcr.tas is the bullring- or arena — ] % j 

Computer: lint's righv, Vayne. L 

How do you knew'. Quote the first piece of evidence that fclte-, 
you without doubt what Las Ventas is, and then say what 
paragraph it r^pears in. 

The" order is important and both parts nust be in the answer* . 

Student: A roaring cavern of noise paragraph one 

Conrputcr: Or.cc you have reed the passage you, know what the "roaring 
cavern" is. Bui; at this point in your reading you do ndt 
know, although ;.*ou raay suspect. $hia is part of the art of , 

I reading. You pick up clues" and hold theti in your nind until 
you are certain. * " * 

What ccltco you certain ,and in what paragraphia it? 

Student: The centre of the ring, paragraph 2 , 

Conputer: "Ring" is not definite enough - it could' Ijb any kind of ring.' 
Try agpin. 

jStudont: The chaplain of the bullring, paragraph 2' ' , * 



By Larry Collins and Dominique Lapiqrre; 
Sijnon and Schuster, New'York, 1968. , 
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{Computed: JXK. , that's fine, f r , 

In Funk & Wacnall's 'Standard Collcce Dictionary 1 the word 
"cavern" i»^eiven as: < 

Cavern .(kav M >rn) n. A cave, especially one that 
is -large or extensive, -v.t. 1. To shut in or as - 
*in a cavern. 2. To hollow oufc. % (KF cavcrne, 
'L ctverno, caVus - hollow) , , , - 

' If vou do not" understand "the Cleaning o^ n. , v.t,, tfF, of L 

> press the "H" he? for help? 'Otherwise press the "Return" iccy.*' 

• •* 

Student: {ftcturn prcssc3]' 

' » ( i>* 

Cocputer: Uhy do the authors describe Las Vcntas as a "roaring cavern 
of. noise"?^- * * 

* Is it becairo: 

A) They want you to sec has Ventas^n your, nind's eye? 
* 0 OR ' - n 

* s B) *Thcy want you to ^car the sound in your nind's ear? 

Type in cither the letter A or 

Student: B / * % *■ * 

t Computer: Yes, co ocl * * * ■ 

They^arc attempting to create the impression of noise. "Noise" 
is .a. key word, reinforced by "roaring". "Cavern" docs, of 
course, give ux the sane visual sense but in agreeing ^thtit t^c 
, ' inafcc is essentially, auditory^ can you tell- me how the* word. - 

"cavern" can hiplp us« to understand better the 'noise' that »:as 
produced? . • ' « • 

Student/ Noises made in a cavern will echo jand rebound off the Avails , 

.Computer: Very ^ood. '< 

The sound would be increased by its reverberation, as the. 
*• . authors are saying is happening iii the bullring. • . 

0*K. Nov .tell me what "v.t." (in the dictionai^y definition) 
stands, for. * * 

Student: I don't know, » 

* ' * Computer: Oh! I thought you knew! 

Vigure I is one of -two algorithms that enabled' the dialogs, to take place. 

A student's problem - even if it is that of guessing rather than working from 
understanding, as he should be doing - is handled. He is abl$ to apply immediately 
what he has le'arfced, and h£ id helped ^o. become aware of the re&aihg process. If he 
has no problems he is- not held up. •„ • " . * 0 

'ihe next question is concerned that the s^tudent is*awdre.of the inportaf&e**of 
sound, of his .ear in reading, the auditory imagination. The question is deliberately 
drawing attention to" the dictionary definition, to familiarize students with fch* way * 
dictionaries present definitions, to^ac#u*a?ge>the use 6/ dictionaries, *and M;o show 
that one .still ha§ to -ufflB intelligently the waning, of the word' In the , cbntext . < 
(Figure Ilh * * #x • , . ;r % - • \. ^ * 

We ask why the use of "mob" rathW than* *!cxowd 1 ' , .what "M&spped'' *ae*an8 A , why* , 
Oarmpna -attempts- an impossible feat, the wofrd^that indicate excitement, and a phrase 
that suggests, something different; and all %he questions lead eventually to Trom your* 
understanding of the" pass^gs, do you think El' Cordobes will kill the bull, or do you 
think he 'will be gored' by. tUd; ♦bull?' 1 s The answer .is not just, guesswork*, -all the clues 
are there, and the student has been made aware of them. . * /" / % ' v 

^ The attention i3,,f ocused on importance of sound 'in understanding by such passages 
as the cme take " f rpp u % Ghristma.8, Cai»al. M < It is not' just- a matted of tfee«teaningB 

of words: ' . * • • J: ♦ , * * * . - ' * „ 

* *JO?ha tape-recording ds .played fircft, then the paasage is givenj lt « . • 

> # i " OW But he was &' tight-fisted hand' at the. grindstone; -Scrooge!^ - 

4 , 'a squeezing, "wrenching, grasping^ ^craping, clutching, covetoUs-, old ■ ' _ # 

i • sinner? ,Hard* and sharp aa a fliit, from Which, no- steel had ever -struck 
- - , 'out generous fire; secret', land self -contained arid solidary as ari oyster. t f 
» The cold within him frozb hia'old feature, nipped his pointed no^e, ' * 

shrivelled his cheQk, .stiffened his gait; made' hi^s ey^sTped, his -thin 
^ , • .. lips blue;' and spok$ out shrewdly in his grating vo^ce* A frosty 



rime was on his wiry chin. He carried 
about with him; he icedhis office il\-th 
one degree at Christmas. 



s own low 
dogdays ; 



temperature always 
and didn't *thaw*|it 



le degree at Christmas. / ♦ , j 

i [Jhe tape-re£ording is played again- after readiftg^ t 



have 




We reverse odr earlier procedure not, just to make a^ change: quite simply, we 
iound that that is the best" approach here, and it is vital not to fall^nto patterns 
and stereotypes. We are concerned with rhythms of the written word; students expect 
rhythms in poetry but seem not to expect them, and certainly fail to respond to them, , 
in prose. ; \ 

• ■ /ailing and rising rhythms are reasonably basic; but we meet the inevitable prob- 
lem by using music. A spin-off here is that some students, who have neyer listened to 
■mytftinr other than "rock", find that there do *xist other, kinds. Oh yes, we'll use^ m 
rook as well. All education is manipulation - but we v are aware of some of the dangers, 
as I have pointed out. We found that after the passage on LI Cqrdobes, many students 
wanted to know more about bullfighting - not unnatural - but they were also asking ^ 
questions on Spain, its people, its music, its architecture. We used discs, tapes, 
shides, to satisfy their curiosity (and to further stimulate, of course). tt suggests 
exciting possibilities for the team approach to computer education: all should be there, 
t*e hardware should be able, to handle it, and the student should be able to pursue- an 
interest by pushing a*button. Many people have had life-long interests triggered by 
similar accidents, and have had opportunities for following them up. Haw many have had 
an interest stimulated and no opportunity to pursue it? How many more nave failed to 
be stimulated? (Figure.* Ill) ' 

Fi^re IV shows an algorithm that; handles sound somewhat "differently. ' 
Here are a couple of other passj^es^we use: . > 

(a) I give a sideways glance at the mirror, and see a puffed face purpled 
with veins as though someone had scribbled over the skin with an indeliD.e 
pencil. The skin itself is the silverish white of the creatures one 
fancies must live un*er the sea where the sun never reaches. Below the 
eyes the shadows bldom as though two" soft black petals had been Stuck 
there/ The hair which should by rights be black is yellowed white-, like , 

- damask stored too long in a damp basement. - . u « 

Well, Hagar, Shipley, you are a sight for sore eyes, all right. 

(b) Upon the .ecstatic diving board the diver, 
poised for parabolas, lets go , 

lets go his manshape to become a bird, ( 
Is bird, and tqpsy-turvy t « 

the pool floats overhead, and the/ white tiles, snow 
their craay hexagons. Is dolphin, ffhen ^ 
is plant uitll lilies bursting from his heels. 

The questions we ask x on the first are: % , > j 

(1) Quote -any pne sentence from, the' first -paragraph and tell me what 
you find good about it. (We accept any answejT;). • . m / #■ 

(?) Whal; does one usually mean when one sejrs *hat "something is a sight 
• Tor sore eyes*? , * - ' ' , . 

* Do you think that is .wAat is meant here? Answer *Yes;or No. 
^Give toe a ward that is given to statements' of tl;at )tind. ^ c 
I am not prepared to run these passages ta death. The student should begin to 
understand tliat good reading is for enjoyment, *ot for asking questions about, by pesky, 
•schoolteachers or crud4y computers. J . * 

We ofifer a student who has enaoyed a piece of writing ;t lie opportunity,*? hear sotie ' 
, mare. "We don't force it on him*. And we give him Just soMuch, <in the hope that, if a 
novel, he will get -the book and read it, or, if poetry, he* wil Wook up some more poetry 
by the same author, of even oust read s6me -poetry. ** m 

\ Remember aiso I stressed that, we considered ali the communications skills as irtte'r- 
, dependent. We look forward to the student writing - it is # surprising (although *I suppose 
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^ The.Sttfne -Angel ; by Margaret Laurence^ ' » h . * 

" Mc61elian<l ftrid Stewart Limited, Torqfatd; 1968. > - 

'•'lines.' frOtf The Lqne Bfitther,* The Rocking Chair and- O frher racms by A.M*. Klein; 

Ryerson Presr;' 19^- ... \ ' ' • • \ > „ : *' ■ ¥ ~ % 



it really sho\4c 



be) what they are capable of producing under the right stimulus. 



We do, of cWse, have some idea of a framework for. all this - narrative, descrip- 
tive, and so to 'exoositdry prose. A fair nunber L of students, using their textbooks, 
fail to remember what the first part of the sentence said when they reach the last part. 
Manvvcannot link sentence fco sentence. By theVfcime our students roach expository 
writing, they have already had many of their problems handled - the story line being 
n valuable connecting link. 

J-orictfliy, it may sqen sensible to start witfh the narts and. build to the whole. 
But in practice" the parts do not motivate t,he student (.only the teacher. knows tnc rela- 
tionships), they tend to become exercises (and therefore *"cvxercisy ) and, bogging down 
on /the mechanics, students rarely reach the gqpdies. Our students work hard to u™er- . 
Stand* tne 'niceties involved in descriptive writing because of the awareness created by 
descriptive touches in narrative. At tfhis level of expository writing -the giving oi 
information - students have nothing but their interest in the sublet and their reading 
ability to carry them along, 

with the passage betow, we do not ask the "student to -listen: if the training has 



lA. 



able to read and understand. 

ining of the ear tefocafceh correct, phrasiyffo, the modulation 
iportant. The author helps the 'reader by adding words that ■ 
fiw j^ult nnun,-.^., A bout tire way the character spoke, what the speaker intended, 
the effoct, what he said had oYi the person he was speaking to, and so on. The writer ol 
scientific prose does not use\this complex signalling -apparatus; he reiies on an unam- 
biguous order of words, the meaning of which As kept as sample a,s pontic, and puactu r 
ation. But even here the reader almost always gains something in understanding it -he 
reads it as if the author Wre saying something to him. It ife not usually oust a case 
o r noting dato nnd of following logic. , • . . . ^ 

• In thfc leg t/nere arc two bon.es, the tibia and fibtila. The tibia ot 
snin-bone 15 lonf> and strong and bears tlie weignt of the body. The 
• * fibula or feplint/ bone is an equally long but much slenderer bone*, a £? 

- ^is attached, to the tibia as jt pin is to a brooch. At the top, the tibia, 
4 ©resents a' broaA smooth surface, which articulates with the lower. end- oj 

the femur, forcing a hinge-Wnt at. t;he knee. In front of the kriee is a u 
small separate/ bone, the natella or knee-cap; Here, again, the bone? 
are fastened/together by strong check ligaments which lamit movement and* 
prevent displacement. Both the tibia and fibula expand below into, pro- 
minence's* of -bone which can be" felt on either side of the ankle-joint. 
Between .these there is an articulating surface into which the top of a 
* ' foot-bone called the astragalus fits, thus forming the ankl esjoinJT. As 
the prominences are .placed on either side of the joint they prevent the 
displacement of the astragalus. The' ankle- t ioi£t is a hinge-joint, and % 
is surrounded nnjd secured by strong ligaments^ 
Space does- not allow ke to gofiutp this program in detiil. But I. would like to . 
point out that the student is.toade aware that the writing of good scientific pwse is on 
art (involving considerable skill) and can be (by some "has!, to. be") learned. He Under-, 
stands not only how' it is done the way it is, but why. J I 

We do ask actions on grammar; but they ape questions! that lead to more important/ 
Questions.' And if he has forgotten his grammar, or is not ,too feurjg, we branch him for 
revision <( Figures V and VI). The dialogue here now is critical. This, it seems to me, 
is the place for grammar. It is'not taught in a vacuum, with a£l the alienation we are 
familiar vith; researches have long ago shown that fhe study of grammar in isolation is 
a waste of -time. But^unfortunately too many teacher* assume^ that 'the, study oT grammar 
is -a waste of time*. • ' ? * ; 

* Snelling v ' There are vastly more important*' skills in communication than spelling. . 
But if a literate public can* rec >gnise illiteracy only as a problem of spelling, so be 
it. We have built a complete inluctive basic spelling program; and, of course it is trtte 
that, whereas spelling is best learned as one is learning to.' read, many students cari b£ 
helped by a knowledge of a few tfasic spell yig. rules 

One example of our approach must suffice. We want/the student *o bfecome aware that 
whexe-the final syllable of a wfcrd is (a) ^tre^ed, and I Op) has a single vowel before a 
single consonant (e.g. bat, renfret), that consonant is doubled ttefore a suffix beginning 

. ' ' - • ' ■ ' V ' - • 

^Man ual f of Human Physiology by^ Leohard Hill; 
Edward*Arnold, London, England. / 
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where necessary. The algorithm (Figure VII) shows what the student dpes after this' pre- 
limxnary work. The exceptions are handled, and he is tested oh his ability to apply 
wh&t he has learned. m « ■ , 

' I have tried to illustrate some ways that we are usipg the computer to overcome 
classroom learning problems- We have* in hand other programs that, with the co- * . 
operation of t£e Rational Research Council of 'Canada, are pushing the hardware to pra- 
vide the, as we see it, necessary learning environment. * 

I have not been suggesting t/nat we'havp^all the answers. I have been posing come 
of the problems, and some solutions that w/ have found to work?. * ^ m 

There has* *to be a developmental structure, Jbut it must leave teachers free to use k 
their initiativp* to build t their own programs, handling their students* problems. The - 
teacher's function is bound to change, and the computer can release him to do things 
that are ^necessary and that he can do better than the computer^ .But it is to be hop«=d 
that he wil> accept the challenge not only of the computer but of his whole teaching 
methodology* ' s 
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"rirvc" in not d'finlt" 
cn«uch ^ It could b* 
■»iy fclnA if*Tinc"i 



Vy t>rifo. 



•\o. . u»k icnr 
(two »orf wrong »tt«jjtt,-*- 

T«y c*iljuH b* lMWr^pt 
th# flr-.t r«ntrne« •f^nt 
c»con4 p«*d£raph. 
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In Punk Vaj-nall't 'Ctt^trd Col \+t* SicticMry*. the *ord •cavern* 
j»»£iv<n »« , ' 

c*y-er» <k»v tro) >n. A cav». e'.j*5it'.2y oct tMt is larjt ar • 
trtensivej - v.t. 1} to «-u: in or At in i cavern. 
* 2) tt hollow tut. (fT Caveme lj. Civema. eavua - hollow.) 

y you 49 not uodersttnd the ttanic; af c. # v. v t..*rU. or L ptett ■ 
v. Vhy it the authors de$-rict Let, *ent«i m a "realise *ivtra of noiee* ,, 
It it because t) 7*ry wint you to tee l+» Ves&s ia ycur ciii'l eye. 

rr b) Tfey want you to hear th» tcuci :n your elnd'o ear* 
- Tyre In 1 



Te^ food.' <» 

They «re Mtttz-jzirc \o erette tn 
lc?r»;*ior'of r^.ie. 

it • keyv»prd. reinforces 
by "roirioj". 

"Ci\era # d«e». of'course. give* ut 
s?-e Utuil jfasc. rUt in aaree- 
ins Vat tie in*r» is essentia*. ly 
auditory* cv yoJ '.•Li se 
*orC'*ciiv r en ?nn ''e'p •*» 
4*rst*.u b*tf*r T v e* ~?i=e 



V^it w3ul<* aeise do' 
in a la r^ectve 7 




\Jo. «•» At -.at r-.-"i ri: » > ricure . 
iet<j« the tuthor., <»e ir7 J -:^ ts * 
create hire, So th*i. tr.^y sunt be 
att^npting to crest* an lep faction 
of noit*. » 
Tois*' it t key v-ord, reinforced by 
"roiri * 

"Cavern do«r, cf <.ovLst. e* v « us j 
soae vitutl ser.»e. Dvt in oc r ««'«f6 
that the ic*;e it ctser.tiftlly auditory, 
ctn you tt'.l ae 1 o* y«a vcrd •cavrrrt" 
?an hflp «js to ^nderttand better :ht 
noic* thnt w»t *ei:r produced' 



lee. Sr.e po;s> vou'.a a« 
Increased by itt re^ei* 
oeration. tt t&i sutfcers 
.\re ttyirc ir Upjeainc 
im the tull rinc. 

:K. How t*H ce vrtt "v.t 
(in the oVticmary defi- 
nition*- ct 



r.otst would oc 
incret^td its r»vtr- 
beratjon. as tSt nuthort 
are ttyin.* is hApp«ninf 
in the buUrln^. 

- h »«0 

Sow tell tt* what 



A Jin t^,e dietjonory 4lfl- 
it ton 3«v r 



Very rood. 
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^sctioa«ry defioitiow ar» itin 
owt liJre the, one we.htvt cri/en vou 
frca iUnV and Vtpiall'i 'Stftcdtrd 
Englifh Dictionary*. IUvt t lf>k at 

' &0 C eC-Q , 
.*Unr prsplt hetUa:t to look t 
»i-crd fey don't know in t. dictionary 
^ecaust :*-ey do.Vt undtrstir'i wr.it 
t w .e *b*orcviat»cna tear.. if tnc 
<tfinitic-.s are looked at coclly 
t v ty shouldn't prtsent too =uth tf 
t problea. * 

Unless one wants tt know th? 
vord hat ccct froa the lotttn *ith- 
ia the trccktti, KF and L iY.$l*U 
Frenth ani fatia) cm be irccat. 
Tba otitr letters ttll ycu t v < . 
f raas%ticil> function of t v .e -or J.' 
*r«t." neanc "vtrb tranritlvf", 
which, tt you fcaow. ntans that the 
word hert is u^ei at a verb anif ract 
t»ke t direct object. T 
>'ov *t*t do you think *a/ tean«? 




I Ohi j^Utu^'. \ 
I yep *r>w. 



Ho. "n." Btaat^'noUD* and 
it it tt t natfn thst wt 
utually ute/tht word "ctvtra* 
Haw if yWhaven't answered 
tht autirion on *r<MiririG 
ttvern^if naita" do tt. 
If ^tu have frett<f)ta f an' 



Xw ^cw. \t you/h%vtn*t 
w^irfortd tha tain a;itftion 

do to by pretsinr 
tt you hava pratt<!)t> go 
to thv n evt ^ne.l 
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Uttta tt it Prt tt 0. 
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It. Vjt 4&tt It e* to jcur +'*\irri '* v^*t 
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Emu rot. Ltrt li *a rxasalt tf t rfcjtta 
>rotfiaelE« 13 orpotitt tfftct. ~ - 
• All it " 
It trcl 



*elc«*3 orpotitt tfftet. ?wtt 0 ttu»i< I «wt tils* yo*r win 
U fcitv* tt « ritls* rhjth*. it £»tt:^vSt ttt myt^a 

rcltta ofxtUttt. R. > > l^gfTTTVgtt. Try 




Titr* It sort tJi#.i,os* vtj tf reading It 
Sm *1V tat wtj» t'At zik* tht inn tfct 
withor lartaitl vsuli tt cIom to tht art 
jeu Lavt fetta 1 ittcr ice tt, »a4.vonid Vt 
ttrtstte tt ftllcvt: ^ , ' 

Ca* fut^M o« t tl£ct-ritt»4 ±m*4 tt 
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.A COMPUTER MANAGEMENT SUPPORT SYSTEM, FO^R « 

' " INDIVIDUALLY GUIDED EDUCATION A 

\ . 



Mary K. Cooper and Gary'R. Tfobey 
PORTLAND PUBLIC SCHOOLS 



* ' ABSTRACT J 

In l n 73, Llewellyn Elementary School, in Portland, Oregon*/ became a pilot school for Indiyidual]^ Guided-* 
Education (JGE) 6 . The management of the system was originally via a manual process. As the teachers 
added mora subject areas to their individual ized program,, it became apparent t+iat the management system 
would have to be improved if IGE was to continue>to be viable. A computer-based management support • 
s/stem was developed # and implemented early in 1975.* This has resulted in a savings of .approximately % 
331 hours of manual, clerical effort each .year;* In addition to saiU1\ying all of the reporting require- 
ments of the. prior manual system, the computer system provides many new management reports which assist 
the school staff in planning, evaluation, and control of the IGE program.* Jhe development cost, to 
date, for the? computerized 'system is- approximately $10,000. 



INTRO DUCTION * 1 

In recen$ years, much has been said and written 
renaming Computer Managed Instruction (CMl). 
T<his paoer describes a relatively simple but 
effective computer-based system that was devel- 
oped* to assist with the instructional manage- 
ment needs of a particular elementary school. 
The computer system operates in a "batch" mode 
on the School District's central computer. The 
S 'Sten was expanded to include one more school 
.in the fall of 1975. The School (Llewellyn 
Elementary) and the Individually Guided Educa- 
tion (IGE) program will bp described 1 along with 
the combuter-based support system. 

B ACKGROUND 

Llewellyn Elementary School is located in the 
Southeast part of the city. Long a traditional 
elementary school of approximately 450 students*^ 
in trades K-B, Llewellyn is now in its third 
year of IGE implementation. 

Several things necessitated this»cheinge. Once 
a stable middle class community, many.famil ies 
began the move out of the cky— their homes k 
rented* to other families of widely varying 
socioeconomic backgrounds. Teachers found a 
wide difference in educational needs of -the 
children now in their classes.. For example, • 
there would be several children of high ^chiev*^ 
ment levels and many more ax'extrerjiely lbw^ ' 
levels. Grade level materials* and traditional 
approaches no longer ,v/orked. No one teacheo 
could ;neet the needs of all. 



In a search for an instructional program to 
meet these needs, administrators read of a 
program under development* by the Wisconsin 
Research and Development Genter for Cognitive 
Learning at,, the University 'of Wisconsin 
(Madison), called IGE — INDIVIDUALLY GUIDED 
EDUCATION. They visited Madison, observed 
the program in operation,, $nd returned confi- 
dent that it would'wQrfc for Llewellyn as well. 

Vih^t is IGE? 

First, it is a PHILOSQPHY — a philosophy that 
holds that each child is unique and develops 
at his own nate. Likewise, children learn at 
different rates and through different methods. 
All ch'ildren^an and will learn when provided 
with the proper instruction at the proper time. 

Basic to IGE is a PATT£RN of ORGANIZATION f6r 
.instruction* — tffe Multiunif school. At the 
61assroom level, the non-graded unit replaces 
the age-graded, self-contained classroom. Eaph • 
unit includes a unit leader, two to four other 
teachers, an aide, and 80-130 students. Chil- 
dren in a unit have a three to four-year age 

span- 4 - v 

» * <* 

At the~heart of IGE is a model o'f instructional, 
* PROGRAMMING for the individual student. Ideally, 
each child's program is based on how and at 
what pace he learns best and where he stands on 
flustering specific skills. Attempting to 
achieve* this ideal involves a secies of $teps 
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which are cru\tlined in Figure 1. 

The instructional program be^fuis with.th£ ident- 
ification of specific instructiGnal objectives 
that are appropriate for' the children of a given 
unit. 'A criterion-referenced, test is then used 
to assess eacfi child's level, of mastery for each / 
skill. The children are thert placed into- small • 
instructional groups based on a skill that they 
need. Instruction is, provided for a 2 to 3 week 
period which is followed by a post-testing to 
determine attainment of the objective.- If a . 
child has reached the mastery level (usually 
an 80 parcent criterion is set^ on the post-test, 
he is placed. in another skill grouping. If he 
does not master the skill, he will be grouped * 
again in the. skill at another time and.with 
♦another member of the instructional staff. 

The Wewellyn school began its use of the in- 
structional model with a reading management 
program develops* at the Wisconsin Res.earch and 
Development Center -- The Wisconsin Design for 
Readme Skills Development. The Design is s 
organized into six skill ar.eas: Word Attack, 
Study Skiljs % Comprehension. Self -Directed , 
fteadi no,' Interpretive Reading, and Creative 
Reading (See Figure 2). Materials for the first 
three areas include lists of skills with related 
behavioral objectives and criterion-referenced 
tests for assessing children's mastery of these 
skills.. Resource and management procedures for 
teachens are supplied. Grouping, of children in 
instructional'groups and the. record keeping of 
skrlls mastered is by means o'f an edge punched 
card-sorVing system in which the da£a foe a 
given skil/ area is kept on a profile card for 
'erfch chira. To identify pupils with common 
skill needs, the teacher selects a given skill, 
•passes a needle through the appropriate hole* 
Jn a stack of cards and shakes off* the loose 1 
cards. The cards remaining on ihe needle 
belong *to pupils who need to work on ttiat 
-skill. 

This method works efficiently when only one 

skill area (i.e., Word Attack) is involved. * N 

But as a teaching team begins providing in- . , 
struction^in Study Skills afrd Comprehension 
and adapts the model to an objective based 
mathematics program -- many hours are spent 
in card sorting and in record keeping. ' 

It was at this point in the < program that it 
fcec'ame apparent that some improved method*of . *^ 
overall record keepjng and of*se!ecting and v 
grouping students was^manda^toryr The School 
District'^ Data Processing Department was*/:on- 
tacted and the problem was related to them. 
The. idea of managing instructional grouping 
and- record keeping was intriguing, and together, 
Unit Leaders and Data Processing personnel 
designed the system. 

THE COMPUTER MANAGEMENT SYSTEM # 

■*\ * 
Durfna the System Survey stage of the projfeqt, 
it was decided' that the system would be.de- , 
^eloped by the Data Processing Department as a\ 
"pilot project".* This* meant a relatively low 
level of resources wou!d be expended on^the 



projects-certain steps in tfrei standard "System, 
Approach^ normally followed, "could be'elimina- 
tefi, and the -system would.be designed primarily 
to fit the, needs of the specific school as . 
opposed to developing a ^general ized system for 
many. It also meant that Data Processing could 
get. a basic system up quickly, and then continue 
to improve, refine, and tailor it as* needed 
dunng\the early implementation stages. "Several 
key points that were to be followed in the sys- « 
tern development were identified. Among them ,' s 
'were: • x 



1. The school personnel would dictate the needs 
of the system, "and it ( w<5uld be designed* 
specifically for them. The existing manual 
process would be changed only when absolutely 

* necessary. * (* 

2. The system was' to b£.kept simple with a mini- 
f mum of resource expenditure. Yet, itwas 

\ recognized that the Llewellyn system might 
be expanded to other schools at & later time, 
"and thus, this would be considered f in the 
t design. . 

* t 

3. The computer was to assist the Teacher or 
•Unit Leader, not take over. 

4. Computer assistance was to be, provided only 
where the benefits were greatest as opposed 
to developing an overall system. For exam** 
pie, ,it was decided not to score th£ tests, 
but merely to input the test ^cOres to the 
computer. - Some factors which resulted in 
the decision "to not score tests were: 

(d) Testing *can be written. *oraJ or by 
observation. 

(b) « Tests are short, easy to score, and 

% the teacher c^tn detect special prob- 

lem areas* « 

(c) Test scoring by qpmputer would have 
required faster turnaround than could 
be easily, provide)} by' a "batoh" system. 

(d) The Data* Processing Department did 
not $a[ye a scanner capable ot Scoring 
tes&'Jn-h&se . - t 

i 

5. The main decision processes were to J>e left 
to the Teachers and Unit Leaders. The .sys- 
tem was only to suggest and provide pertin^ 
%hVlrtformatiort. *i 

The Wisconsin Research and Development Center* 
was contacted 'early in the study to see if they 
were planning a computer -based support system. 
It was found that 'they were, bt/t it was in the . 
early stages of development and would need to * 
be modified to nfeet our specific needs and com- 
puter hardware. They did* however, prdvide 
some excellent information related to their 
planned system. 

The basic system can best be (described by re- - 
ferring to the general flow model (See Figure. 3) 
There are several special reports and input 
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docume/itte in addition* to those indicated in Fig- 
ure 3. » Th'ey are required 'primarily for system' 
and file initialization and~maintenance, and 
will not£ be described ia detail jjeVe. . 
• « « * • 

The, normal process begins with a determination 
by the Unit 'Leaders' of which skill qroUps they 
wari.t to teach in the next* gr©6pitflg cycle. They 
make this determination- based on Unit Perform- 
ance Profile reports (See Figure 4) and a know- 
ledge of what resources (rooms, teachers', 
materials) will be available. The Unit Per- 
formance Profile shows pertinent mi formation, 
regarding the performance of each, student, and 
of the unit as a whole for each*sk£ll objective. 
* ' 

A Grouping Request Form is then prepared andL^ 
sent'to'Data Processing. The desired skill 
groups; along with any special prerequisites 
or forced groupings, are noted on the form, 
"[he Grouping Requests are input to the computer. „ 
The computer produces Specific Grouping Reports »* 
(See Figure 5) byj&termining each student's 
eligibility based on previous history of skills 
mastered, prerequisites arnd dumber of previous 
attempts. "The Specific -Grouping Report is a j 
Hst of aril those students tnit are eligible t ' \ 
for the specific ski IT. The students- are listed 
on the report in sequence by heed. Students 
that h?ve made prior unsuccessful attempts and 
are not eligible fcp^many, or any otheVskill * 
group s, app ear, first on the reports The Unit 
Leaders modify the report ss tiiey see fit, draw- 
ing lines through those students that they do 
not wish to have, taught in a' given 'group. The 
resultant report prpvideS- a "class list" or 
"roster" for the teacher that is in charge of 
the group- A report "is also provided that shows 
students that are not eligiblefpr any of the 
skill groupings. , 

The learning process, usually of two or three 
weeks, then takes place. Students are tested* ' 
and mark* sense score cards, which have been a 1 
prepunched by the computer and printed by a 
card*, interpreter, arg marked' with the students 1 
scores ; and submitted to Data Processing. The 
computer then updates the students' records. 
New Unit Profile Reports sre then provided for 
use by the Unit Leaders in determining, the , 
next set of potential .skills to be taught. , 

Upon request, individual Student Profile re- . ^ 
ports are printed (See Figure 6). They -pro* 
vide the teacher with a complete list of all , 
skills that have ,been attempted by the student. 
It is useful in evaluating and* reporting indi- 
vidual student progress. It is especially use- 
ful for parent/teacher* and student/teacher ! » 
conferences, and thus i§ often requested near 
the end of' a grading period. 

An Administrative Summary Report (5ee figure 7) t 
^can-also be. provided upon request,. Jt is used 
'primarily by the principal" and provides'a summary 

of the perfbrmance of each Unit in the school* . 



CONCLUSION 



The Computer Based-Instructional Managj£me*nt^ 
Support Sy$te*i, as briefly described \ n ,ttis . 
paper, has been successfully implement«a*in » 

\ the pilot *schdol aqd is being .used ort a limited 
basis ;at one frther ^hool . The project has 

^VdemonstratedL to School District management^that 
the computer, operating in a • batch mope, can< 
provide' a significant and cost 'etfetftwe contri- 
bution i&.the instructional process. ,!The door\ 
has feeen opened for'additional, future^develop- 
njents in -the area, tff direct instructional*, 
support^by the computer. " , » . * / 
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State the 'educational objectives to be attained by tlje student " 
population of the building after a f year,c*and longer time per- 
iods in terms of level of achievement and other performance 
related to each curriculum area and in terms of other values 
and action patterns. » . 



Estimate the range of objectives that may be attainable for 
9 P subgroups of the student population. 



*Asses^ the level o"f, achievement 
feion level of each student by u 
tests, observation schedules, ai 
sized subgroups. 

— . Ll 


, learning style, and motivar 

se o£- criterion-referenced 

id work samples with appropriate- 


1 

* 1 




Set specific instructional -objectives for each child to attain 
over a shor.t period of ^time. 



Plan and implement an instructional program suitable for each 
student by varying (a) J the amount of attention and guidance 

, by the teacher, (b) the* amount of time spent in interaction 
among students, (c) the use of printed, mate'rialfe, audiovisual 

•materials, and direct experiencing o'f phenomena, (d> the use 
of space and equipment (media) and (e) the -amount of time . , 
spent by. each student in one-to-gne interactions with 'the* / 
teacher or media? independent sHudy, adult- or student-led- 
small group activities, »and adult-led large group activities. 



Assess, students for attainment of initial objectives' and for • 
setting next set of instructional objectives** » 



Objectives 
not attained 



i 



— _ J Objectives 
Attained 



Reassess the student's, 
characteristics 



Implement next 
sequence in program 



Feedback 4 



v FIGURE 1'X 'Instructional Programing Model in ,IGE 
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, , • - ' 4 LLEWELLYN PRIMARY SCHOOL. 

(Sample Objectives) 
\, * ' ' READING SKILL, SEQU ENCE 

~ 7 ~~* i ^ . ' 

Wprd^Attack Skills : (K-4) **5 Objectives (linear; sequence) 

* * • * 

* 1. Shapes; Letters and lumbers • 

2, Rhyming wbrds s and Phrases ^ ',f 

3. Words and Phrases v " \ ' ' ^ 
• k. Beginning and Ending Consonant founds; .Consonant Blends 

5* Plurals; Possessive^ * ' \ t ***** 

»6. Long Vowel Sounds - / ' 

7- Consant Digraphs / , % ' 

8, Vowel + r, a + 1, a+w. etc f * „ * * ^* 

9. Dipthongs / * % 

ip. Base Words / • ■ 1 

11. Homonyms / * * , • 

12. Multiple Meanings 

"■ 13» Silent Letters * » 

. 14. Syllabication f * * 

Comprehension Skills ; (1-6) 3** Objectives (linear sequence and concept strands) 

• > r " • ■ r ' ' » 

i. 1. Wain Idea ^ . .* . ' * 0 ■ 

2- Sequence * -' ; 

3» Reasoning V ■ v * i • 

1 a. Synthesizes ^information v # • & - 

^ / b. Predicts outcomes ( ' * * » - . 

, c. Cause and effect relationships ( x 
d.- Syllogisms »• ' f " 

' " 4. Detail,/ , i ./ r * 

5. Context Clues 
r 6. Affixes . 



■ • ■ ■/-'. ; ■ 

Study Skills ^ ^(3-8) 71 Objectives (linear sequence and concept? strands) • 

* 1. Haps ' 0 W> . ' _ 

4 *, : a. Repfrcsentatidn^^ ^ ( *\ 

'b.- Onentatio'n v x * * - • 

, c, Measurement * x ' ^ . tf . „ > 

# 2. Graphs and*T a bles . # ~ 

3# References •'' • 

t a* Utilization ~, . * 

/ • ,b« Location* t , & . # ^ / 

c. Organization and evaluation k " / 

* . " • . ■ . / - V >.*' ■ v.. ! - 

OTllER ASPEftrS OF PROGRAM : Basal Reading Sejrfe^^ flli.- 7^ ,- jlJ r ~ - - 

•1. Self-Directed Reining S # v , *' ST ' ~ ' • • " > 

2. Interpretive Reading • t * s .„ s> ' 



e» Creative Reading 



FIGURE 2 
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'general flow model 
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THE INTEGRATED USE OF PROGRAMMED INSTRUCTION AND CAI 
TO TEACH THE APPLICATION OF LOGIC AS A MEANS FOR 
DETERMINING THE VAi^E OF MANAGEMENT INFORMATION 
- AN EXA£#LE OF THE USE OF CAI 
WITHIN THE DEPARTMENT OF DEFENSE COMPUTER INSTITUTE 
/ 

by B<?&rt H. Orr and Judith A. Watson 
Department of Defense Computer Institute 
Washijrtgton Navy Yard, Washington, D.C. 20374 



. / 

ABSTRACT. Thc.Departme^jf oH)tfensc Computer InstituttLhas developed an integrated approach to teaching 
Cnctional managers and j*$ers how to get* more -out of,t{i,eir Computer Based Information System^. This approach 
4ncorporatcs Programmed Instruction- (PI), Standard Lectures, Seminar/ Laboratory Sessions and Computer 
Assisted Instruction^.^]) Techniques. Specifically, the PI text instructs trie staCteflUiii^he^ fundamentals of symbolic 
logic. crophdfcizingtthe notions of conjunction, -disjunction and negation. Additionally, it serves 4 as a foundation for 
a CAI lesson vv^h presents the application of Boolean and Tri -state Logic concepts to aid in determining the value** 
of manaeemo^t' information, • . / 

jf " ' " ■ . . . " 

/ J&u Department of Defense Computer 

Iiibtj^Ke (DODCl) was established in 1964* for the 

expressed purpose of teaching both military and 
^civilian managers/ within the Department of Defense, 
•'how to better use the computer as a management- 

tool. All of the Institute s courses rang? in length 

from two to ten days, and deal *tfh such subjects as- * 

computer system security and privacy, computer 

performance evaluation, specifications for 
. selection, systems ati&lysis and design, informa- 
tion management, requirements for teleprocessing, 

and a. basic introduction to computer technology . 

It is tn the latter course that the use of Computer 

Assisted Inst ruction v (C A I) appears the, most 

promising. , ' , 



minutes has been adopted. Tfiis will maximize the 
students' opportunities to make use of the CA^ lessons 
both durin^the* allotted course timt and the students' 
freeynj^- . ^ , 

* The remainder of this paper will be organized 
into two sections, the first describes the specific 
approach taken to adapt CAI principles to DODCI s 
heeds, while the second describes an actual lesson. 



y 



In considering how to best incorporate 
CAI techniques into DODCI's^rogram of instruc- 
tion, the following facts and circumstances were 
considered: , . • 

* 

a. For a variety ofc reasons not germane 
to tjus dlscdssion. the present instructional 
format consisting of lecture, time sharing labora- 
tory and seminar techniques must be maintained. 

t b. DODCrs.tlme sharing system consists 
of the Hewlett-Packard 2000C* computer, system \ 
and twenty remote terminals servicing a normal 
course enrollnYent N of forty students. \ 

4 "* 

\ c. A f maxlmum ol two classroom hours 
can be devoted to CAI, although students mfity use 
the time sharing system during lunch and after • < 
thfc normal academic day. , . ' a V 

Consequently. , the philosophy tll^ students should 
bc v able to^omp^etc.aU CAl^ssoijs^ within twenty. 



Each CAI lesson is organized into* three „ 
phases, an introductory phase, a reinforcement phase 
consisting of review sessions (i.e.,' review quizzes 
and remedial units), and a phase presenting new ' 
^material consisting of learning Unlts s and a final test* 
(Sec Figure 1). The total-package provides learning 
and reinforcement lo the student, as well a.s informa- * 
tion to educators on the effectiveness of prior InstVuc- 
tlon. 

The Introductory phase gives the student aft 
overview of the total lesson. This Dhase serves to 
place the student as much at ease«as possible by ^ 
explaining the interactive capabilities of computer 
terminals and familiarizing the student with the *■ 
forthcoming lesson. ■ ' 

4 * 

^ x _ The reinforcement phase ts designed to insure % . 
that the student, ha^ mastered the material previously f 
taught through lecture, upon which the new Subject 
matter is baaed. Therefore, each lesson authQr first 
determines the specific lectures to serve, as* foinda- ' ^ 
tlons for the CAtjesson, % Tfye author "then identifies % 
those specific teaching points which should be^ , § 
masteredy The studdnfs, mastery Is ascertained by 
administering a computer ass^sfed test/xhe afore- : » 
mentioned review quiz, bear in mind Uiat the subject \- 

, matter Covered in each review o^u^ptajams to a j . ^ 
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single course lecture. Phe quiz usually consists of 
five to seyen questions. For each question, the 

. student has one trial m which to answer correctly, 
he progresses until he renders an incorrect 
response, at which time the student is branched to 
a remedial unit. The remedial unit, activated 
contingent to prior student responses, is designed 
to reteach the material covered in the review quiz, 

. Upon completion of the rem«Tial unit, the student 
retakes the quiz to reassess his mastery , Correct 

\rusponses on any re -test would still indicate mastery 
Since the review quiz is confined to single word or 
multiple choice formats, and an incorrect response 

. is not explained during the qoiz, r In the event a 
student again renders an incorrect answer, he is 
* immediately returned to the remedial unit for further 
.work. The possibility of this cycle proceeding 
indefinitely is not anticipated as the quiz has been 
designed to realize a high percentage of correct 
responses. Due to self-imposed limitation^, the 
reinforcement phase is constrained to a maximum of 
two review quizzes, along with their associated 
remedial units , Once the student successfully 
completes these review sessions, he is branched to 
the new material portion of the lesson. 

The new material phase reverses the sequence 
of events which transpire in the reinforcement phase. 
New subject matter, is presented to the student in an 
interactive lashion. When completed, the student is 
tested to determine hfs mastery of the new subject. 
Any incorrect response will automatically res*utt in 
, the student's return to the beginning ^ , 
of*thfs*tast phase,* Correspondingly-, all correct 
responses reflect Juffictent comprehension of the 
.material anci.thus^ constitute successful feason 



completion. 



Consider an actual lesson illustrating the 
design philosophy 'descr ibed aboye. This lesson is 
based on tho students ' mastery of three concepts: 
elementary logic, mathematical modeling, andihe 
value of management information. 



student is ready to attempt the new subject matter 
that comprises the final phase of the CAI lesson, A 
part of an overall Student Progress Review examina- 
tion tests the students' comprehension of logic. The 
master of the other topics is ascertained as part of 
the reinforcement phase of the\^Al lesson. 

After completing the introductory phase, the 
student enters the first review session and receives a 
quiz on modeling. As described earlier, any 
incorrect response will cause the student to be ' 
branched to a remedial unit designed r to teach/review 
the types of models, their purposes, and the signifi- 
cant advantages and disadvantages of modeling. 

Likewise, the next review session begins with 
a quiz on the notion of information values, -this quiz 
is also supported by a remedial unit designed to . 
guarantee the student's mastery of this vital subject, 
( NOTE : For the benefit of those not familiar with this 
topic, a brief explanation is presented below), 

A quantitative approach for determining the 
value of management information in a manner similar 
to that of a production shop is generally not feasible . 
The production shop determines a retail value for a ' 
service or commodity bas^ed on the fixed and variable' 
costs of produtiog..;ha,t. service or commodjfl&J, The 
retail coetAa cliosen^o enhance profit margins, 
Etgure i graphically portrays why Oh Is technique is 
'inappropriate for assigning a value to management 
information, v * , 

Information Value ^ 



w 



A 



Cost 




Variable Cdst 



Rv\e4 Cosr # 



9 Figure 2 ) 



* / The student learns the fundamentals oflogic < 
by .completing a Programmed* instruct ion (Pi) Tfcxt, „ 
Tho use of this PI text serves two purposes. First, 
it expose s*the student to a diffcrent^Cchniquc for 

.the teaching of new material: ttfis technique 
capitalizes on the benefits of selfrpaced mstrOc-* 
tion as a realistic and highly successful form. of 
education. Second, if introduces the .student to . 
some fundamental. <E A I techniques (t,g, lesson 
frames, student dialogue, immediate reinforce? 
ment). This; preliminary exposure should rfilnir 
rntze Any "culture shock*'* which might ttherytfsp 

'.be experienced, bjra student encountering bk\ fdr . # 
tho first time, # T */• ' * 

v , . . 1 - 
*Phe ojJjpr.concepts arq introduced and first # 
taught'ustng the normal class rflom lecture fpri^fat 



nor 

> The three concepts t 



be mastered before trfe 0 



While the fixed cost for operating a management,, 
information system can be determined; and. while 
ttjc actual cost for producing information (variable 
cost) can be calculated, it ^is impossible to quantify , 
the net worth of the information produced In order to ^ 
justify its cost of production. Rather, managers must 
make a more subjective appraisal of Information f\ 
value. Consequently, students are taught a composite 
of various management theories referred to here as 
the "Value Added "approach. Essentially, informa 1 ^ 
tlon has Its value enhanced as one or more of the < 
following states' are' realize^, » 

VALUE ADD^dVaCTORS ■ '< 

l # Admlafsfratpjr's are glven^nov^ed^H 

to mawfi^CscojKf of the probfcprft ' . * . * 
for vvmcVthey are responsible^.* 
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2. . Dec is tons «re made that othe/wlse 
would no£ be made. ' * * 

S 3. - Decisions by analysis prove better 
* L than decisions by insight. 

f '* 

4. The scarce commodity of managerial 
insight is freed from lower-level 
decisions and can be applied to 
higher-level problems. 

5. Decisions are made sooner because 
of increased confidence. 

Once the student has demonstrated his 
mastery of the aforementioned material, he is ready 
to begin the iinal phase of the CAl lesson. Here, the 
student is taught how to apply Boolean and tri -state 
logic functions to build a mathematical model which 
can be used^n producing a relative measure of the 
value of management information. The solution of 
this model would provide the manager with a means 
for assessing the utrlity and effectiveness of his 
information system. 



Here, the IVi values can be interpreted as 
follows: 



IV. = 



*| I if information is of "significant value", 
else . 



where . ,«. # n 

and n_ defines the number of Information 
^» Value measures td be modeled. 

Repeating the above process/ substitute time, T, 
with a variable representing cost*. 

Let C„ the cost of preparing a'-pie^ of * 
information, be defined: 



1 If economical, else," 
0 



Then IV 2 Is defined as a function of C and D: 



4 For example, tWo of the most important . 
managerial resource^ are time and mohey. A series 
of Information yalue measures can be defined by 
describing them first As functions of time and each 
of the five Value Added factors, and then, as 
functions of cost ana/the Value Added factors. As 
an* illustration: 





1 


4 


f 






, 0 


o. 










0 







Let T, the time a manager, spends reading and'// 
understanding some piece af information, be 



defined-: 



Each of the TXher Value Added factors could be 
similarly defined, giving a tdtal of ten different 
' Information Value measures; v 



\ [O if time spent is "excessive", elsty 
/T = < * . ' • ' ~ // 



* Let D, representing Value Added faqtor 5, 
, - i>o. defined: \^ f 



D > 



0 if decision isjnot made sooner, ejse^ 



Next, define the first pf or mat ion yalue 
' , Measure, IV^as a fiinctlda ofT and'D: \ 

? ?; 



0' 



"0 



0 



■ £ V i 



i * 



V, the-value of the jtft piece of information its. 
def tried as: ■* * 

■ V = — 



For*J =» 1,2, . ,-.,Vn pieces fit information 

• **. # 

I = 1/2, /. .,n rnformatlon.valtie • * > 
measures < ' ** 

Finally, a measure of Total Information* * 
Effectiveness, M^jfe defined: * . 
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Note that in the above two matrices, the logical 
A Nonfunction has been duplicated. This need not - • 
have been the case. The CAT lesson emphasizes 
yiat each modeler- must/ provide his* own Interpre- 
tation and must define each function In a way suitable 
to the modeler's analysis. The above definitions are 
> the writers' interpretation. Recognize, also, that 
the £AI lesson emphasizes approach and technique „ 
rather than, a detailed development of the entire 
model, - Most of the function definitions are 
reserved for the studanC as exercises. Further- 
more, the teaching philosophy is far less rigorous ' 
than* the above definitions imply. This 4s because 
the students do not" all posses* the mathematical, 
sophistication necdssafy to comprehend a formal 
description of the model , Hence, the teaching of 
this top$c follows more intuitive, lines. ■ 

Because the student may have* some reserva- , 
tions concerning the precision provided by the 
Boolean functions,a«a final teaching point, the use of 
tri-state variables is suggested. To illustrate, the 
functions T, D, and IV y are redefined below: 

-i if time is excessive 
T = < 0 if time is average, else 
+1 



Computer Assisted Instruction to produce a wx;il- 
balanced, highly effective curriculum/ 

Acknowledgements : All CAl programming was done 
using Hewlett-Packard's Instructional Dialogue 
Facility (IDF). The authors wish to*hank our 
Director, Captain J. W. Rlehl, USN for his many- 
helpful suggestions. We also extend our thanks to 
Captain Clifton 0. Reynolds, USA who programmed^ 
the bulk of this project. 
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The Information Value measure Implie-s ttfet the 
information itself is either Irrelevant (M), / 
"nice-to-have" (0), or relevant (+1). The 
" statistical measures previously defined are still 
valid. 

Once these Ideas havb been presented, 
each ^student/takes a final test to ascertain his 

• mastery of the new material . Again, the student 
{ ^Automatically branched to thobeglnnlng of this 

hnal-phase whe*hey.er an incorrect answer* is ' 
given. Perfect completion ofKhd test constitutes 
^CAI le#«on completion., * 

< . In summary, the DcpartmenFof >DeYen£e 
Computer Institute Is developing an Integrated 
approach to Its courts, of Instruction by 
, combining thfubest features of lecture, ^ Program- 

* mbd Instruction,, seminar/laboratory, and < * 
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ABSTRACT. Rtlcent literature indicates (fiat the CAI discipline is beginning to impact students at all levels of 
educatiop, rather than remaining strictly as a research device. As CAI begins to impact students, the problem 
, of communicating CAI principles and,langua£es to the "average" teacher develops. An alternative Method to the 
traditional approath of classroom instruction is to have the computer teach its own CAI language . In other words, 
to have a CAI tutorial created to teach 4, CAI language. An attempt to fulfill this goal has been accomplished by the 
development of a C^I tutorial to teach the CAI author language IDF. The main purpose of the^ tutorial waafo pro- 
vide instruction in ^DF so a^ to effectively eliminate the initial teaching of IDF in the classroom . The main instruc- 
tional goal of the tutorial v\a& tba* the user* would be able to create a CAI prygram using IDF with the author's man- 
ual iunctioning as a inference. The tutorial discussed eight major areas of IDF and followed a linear instructional 
strategy. A pre- tesi^ post- test evalution procedure was used to determine the effectiveness of the tutorial. Re- 
sults, were significant^ the ,03 level, however, they also indicated some revision was necessary. It was deter 
mined that the major instructional goal had been achieved with relative^success . In developing, tutorials like the 
one indicated -above , teaciiers neod only go to the computer in their own school environment to learn its CAI lan- 
guage. In this manner, v\e can effectively eliminate the teaching of CAI languages in the classroom, and thus 
convey the principles of CAI more Veadily . \ 



Introduction and Rationale 

Large amounts of money and time have been 
spen^ in order to place computers in education, 
" . . . but tfie average teacher remains uninformed 
as to what it is and how it works ." (9) The "aver- 
age"" teacher of whom Porter speaks needs to be- , 
come knowledgeable about computers since the 
computer is becoming a part of everyday; life in the 
school. Wallace has said, "Despite the surge of in- 
terest in CAI, there is a clear shortage of CAI ma- 
terial . . . A key reason for this shor^ge is what 
migfct be called the teacher/programmer gap." (14) 
in-order that this shortage may be lessened, a 
method or methods of training for the average 
teacher must be'developed. Material must be*de- 
veloped to hel^^ct'ucators learn procedures for or- 
ganizing, the content of a CAI program and under- 
standing the^asfccQOgepts of CAI and the com- 
puter in general. This is accomplished to some 
degree m-the CAI and computers -in education 
courses offered on many campuses. These covfrses 
are excellent methods of acquainting'the teacher 
Mfcith'general computing concepts and the d>fferent t 
aspects of CAI. however, many times they^lo not 
provide a firm foundation of programming tech- 
niques the teacher will need to -use -to "input" their 
modules onto the computer. It is essential tha^this - 
be expanded tp include the programming tech- <* 
niques and concepts so educators may become more 
a, ware of the capabilities of the particular computer 
available to them in their own school environment. , 



* One of the possible vehicles for accomplishing 
th;s is to have the computer teach it's own CIA lan 
guage, that is. to have a CAI tutonial written to M , 
teach a CAI language. Thus, these modules coulji^ 
be included as a part of the basic software package 
given with each computer* This would then essen*" 
tully elimiriate the* responsibility ofa^athing the # 
programming concepts in the classroom. » h 

The iftajor purpose of this fetucty was to work. 
toward the above objective by developing a CAI \\i 
tonal designed to teach a CAf language* The sub 
ject area*o£ ihe tutorial was th/e fundamentals of.fhe 



] 




Hewlett-Packard (HP) CAI language called Instruc- 
tional Dialogue Facility (IDF). 

The tutorial this paper discusses is the first in 
a series of three. The second tutorial will deal 
with the utilisation of the IDF Editor- Documentor 
<EDDOC) program, arid the third, the use of the IDF 
Utility Program (IDFUTI) . The second. and thircV 
modules are currently in the pre -computer stages 
of development* • , 0 

There are several reasons^for thi» development 
of the tutorial. It is hoped that the tutorial will 
help the "avera ge" teacher keep riace with the ra- 
pid development of computer technology. Also* it 
is hoped the tutorial will help h> overcoming the 
"teaclver/programmer gap" (14) arfti thus, as a, 
consequence, help to eliminate the shortage of CAI 
material. The tutorial is also an attempt to show ' 
the computer illiterate teacher that, when, used 
property, it can be an extremely valuable tcjoj, 
giving him/her mojre time to gevelop oneto*one re- 
lationships with each student. It is further In oped 
that the tutorial will be a "stepping stone" tor 



teachers to gain insight info the princ 

. « 1 • 

and nlore*generatly the application of 

education. _ • 



plesjof CAi 
omputers in 



^ho^ma*!?! purposcof the tutorial s to provide 
instruc^on'in'IDF so as to effectively eliminate the 
initial Reaching of IDF l^ the'llassrojOT^Afte^^m- 
p/eting {he tutorial'i the,u%er may then attend 
clAss or several classes or seek a consuf^ajjt ,to"?Ui- 
sw fc er questions and learn some advaHcecl tech* * 
ntques jof IDF not-^ts^ss'ed in«theJtutoi'ial. 

1 .* - r- 

I The target population for which this tutorial 

/was developed is 'that gfojip of educators that have . 

had little or norpre'Vious computer programming 

experience. It can be' tSsed for both pre -service 

and ln-Serv^Ce*training. * 

TKe major instructional goal of the tutorial, is to 
provjdb the basic .understanding needed to*?re^te a 
»CAI program using«IDF ^ with the author's manual 



functioning as a *eterence. In addition, the module 
should' give the user an appreciation" of the lira;- 
tations and enhancements a computer can offer edu- 
cation. Finally; it should give the user an under- 
standing of the process involved in the creation of 
computer based instructional material on the HP 
computer. // 



tie si 



HE 



In order /or the major instructional goal to be 
accomplished, it was determined that the user 
• would need to study eight major areas within IDF. % 
These are: 

A. Preparatory Operation$or Activities 

B. IDF Lesson Options x 

C. General Guidelines of Sections 

D. IDF Section Options 

E. * IDF Units *, 

F . ~ IDF Intralesson Branches 

G. IDF Selective Branches 

H. General Procedures of IDAF 

Behavioral objectives were, written for each of 
the areas and test items we re'-d^ve loped for ejeh 
objective. The module wa's then prepared accord- 
ing to the specifications established by these objec- 
tives a*nd test items . 

As with most computer languages, IDF is 
learned by a process of ^building" on the previous 
information given. As a consequence and based on 
the behavioral objectives, the module was arranged 
such that the instructional strategy was linear and 
. non-learner controlled. By using this tfype of in- 
structional strategy, it was felt the "building" 
process would occur more efficiently than with 
adaptive or learner controlled strategy. ' 

. Based ptrthe given instructional strategy and 
the eight major areas of study, the specific module 
structure was developed so that the information in 
area A (.see previous list) 'was presented before the 
v information in area B, the information ; in area B 
. Was presented before the information in area C, e 
•etc.- After area H was presented, a post-test was 
"administered to determine how well the student had 
learned ana^o give the student an indication of 
those^oncepts that he/she needed to review. 



JTHe testing-lprocedure used to determine the 
effectiveness of learrilng^thathad taken place dur- 
ing the use of the 'module was* the pre-test/posj-test 

estgn. A control group Was not used because it 
was asauiried to be very unlikely that post-test per- 
formance would be significantly affected b,y having 
takpn the pre-test or by incidental learning during 
the time between pre- and'post-test and because a 
comparison with another mode of learning was not 
to be made. 

In developing the test/ each behavioral objec- 



tive was examined to determine precisely what was 
to be.tested, A test question was then written for 
thai particular objective. The purpose in writing 
only One test question per objective was to facilitate 
the revision process. Thus, based on^he item sta- 
tistics and the objective, the test question and/or 
related module material could be revised . Howev- 
er, in two out of the forty-three objectives ^two 
questions were written because it was felt thai the 
objective could be tested more adequately, * 

o 

The pre-test and post-test contained the same 
questions with one exception,. The last question in 
th,e pre-test was an inquiry as to the previous com- 
puter programming experience the user may have 

• had. If the user answered affirmatively to this 
question, he/sne was then asked to list the com- 
puter languages in which the experience had oc- 
cured. The last 'question on the post-test provided 
an opportunity for the user to make any comments, 

* criticisms, or remarks about the mocfUle he/she 
desired to give, 

All testing was^done on the computer. One j 
trial was given fc^r each question in theprertest. 
Since the pre-test was the same as the post-test, 
no feedback was given in the pre-test as to the cor-, 
rectness or incorrectness of answers given , The 
%post-test had two trials on each question to allow - 
for typing ;^rrors . However, when the results 
were compiled , only the first trial answer was 
used. The tvgo trials for the post-test questions ♦ 
was primarily a device to enable the user to correct 
and/or learn from his/her errors. Feedback was ' 
given on each question in the post-test indicating 
to the student correctness or incbrrectness of the 
answer. In the case of two incorrect answers, the 
correct answer was displayed to the student. 

frwo separate testing geriods were used. an*in- 
iti attesting gkase and a final large grou£ fieTd test- 
ing phase. The purposc,on the initial testing was 
J to cfetermine problem areas in the module so revi- 
\ sion could be accomplished before the large group 
fiel/d testing occured. 



After the'large group field testing, the Scores 
from the pre-test group a.nd from the post- test " 
group were compared,* A t-test for related sample f s 
was used to test for the difference between the two. 
Also, using the K. fyt ^0*. the reliability of each* 
test was computed . 




The reliability of'the pre-tes found to be 
0.88 and' the reliability of the posHes'fc was CL89/ 
Forty-six students completed the preVtesf anck of 
fhese, thirty-onelalso completed theptost-test. 



The means, variances k and s^andartji deviatic 



for each test are ishown in Table ll 
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Pretest (N=46) 

• "x - 9.391 
*? 44.803 
" s r 6.694 



Table 1 . 1 I 


4 


t 

Test Results 
> » 




. Post- test ( 


tf=31) 







x = 2^.58*1 
s-= 63.85$ 
s = 7.991 



"The null hypothesis tested was that the dif- 
ference Jjetween .the meansi on the pre-test and 
post-tes| is ?ero.' A t^o-tailed test with a .05 
"level, of jSignificance was used. The tes't statistic 
was'fouhd to be 1 1.837. The null hypothesis 
was;, therefore, rejected. 

There were six items, 'in the post-test haVing 
less *than 60% of, the users answering the question 
correctly . Also, there were eight items in bO i- 
69.9% range. The^emaimng thirty -one items 
had success rates of/^0% or better. 

* \ s' 

The last question o(jthe' post-test, as dis- 
cussed earlier, was an tylquiry or invitation to 
the use? to make* comments, criticisms, or re \ 
marks. The question was not structured in any 
«mapner so as to allow fprthe greatest possible| 
range p£» responses . > * ^ * 



The responses obta^ ned £an be classified it 



to 



Tour general, categories; 



1. Unfavorable ruction [/ 

2. Indifferent reaction J 

3. Indifferent^ faVprable /eac^on 

4. Favorable^reactioft 



4. 



The responses in category one were those con- 
sidered to contain negative reactions to the tuto; 
rial.. Category two responses* were of a nature 
such that no^crijicisms-,* either favorable or un 
. 'favorable, were made. The basic *su)>stance of 
/ each response in this category *a ^suggestion 
or* a note about a specific answer he/sr\e felt 
should k be checked. Also included 'in this cate- 
gory were ideas about possible Revisions. Re- 
sponses in category th*ce were tho.se that usu 
ally contained a favorable reaction to the module 
and offered suggestions for opssible revisions. 
This category contained more responses than any 
other category. The responses in Category four 
were those regarded as having a fayonable re*-\. 
action to. the module. In a-fc*w 6f»these re-, * 
sponses, minor suggestions and/W comments 
about a particular question were offered, howev-* 
, er,fnoSt of the£e«did not contain any particularly 
useful 'ideas. . • 1 

- \ . ' • . , 1 - 

' One'idea that was found to be consistent 
throu^put all categories' basically related to the 
mechanical nature ojf the terminal, This 'was that 
typing In general on* a teletype is a difficult ex- 

. • t ■ ' ;• • » ' * •• . 



perience. Many also added that their poor typ- 
ing skills was a source of considerable frustra- 
tion. ' ; 



Revision 

! i 

„The datalfrom both the'specjfic 



questions and 

the last geneiral question on the post"test provide 



the information and the basis by^ which the module 
is to be revised. It was,determinet .from the data 
that revisio 
necessary 



in both the tests and tjie module was 

* {• 

J * - .» • 

If the siJccess rate was mucjh greater than 
chance for the item, in the pre-(tes , it^was- reas- 
sessed . In ihe post-test, if .thej su :cess rate was* v " 
below 60%. the item, objective,' an ^related module 
material was also reviewed . Finally, if the success 
rate on any, material in the*modulc pot related to 
those examined as a co^seque^c^e >f the abov^ crite- 
ria was less than 85%, it was examined^ fortunate- 
ly , no items were in the case c^f the latter. 

In the |p re- test, two items; hap a success rate 
much greater than the chance success tate\ These 
two particular questions wer<* examined and will be 
rewritten i In prte case, the^cjbj^ctive was consid- 
ered to be faulty and thus wijl also be rewritten. 

1 • ' 

l In the post-test, items Were classified as Type 
I, Type if, or Type III revision. 1 Type I revision . 
occured when an'item had an acceptable success 
rate (above t 60%), but was mentioned by © user or *■ 
users injthe Comments. Type II revision was babed- 
on low success rate (equal to or* less than ,60%) . 
Type ill revision was based on both low success 



and user comments. 



rate 



I 



1 « In the Type I revision category, Itvyas'foufid 
tltat most user comments dealt with the problem of 
typing an answer and having it rejectee? by the com. 
puter. This was primarily the author's fault for not 
anticipating^ all poSsible,answers. Thus, these 
questions will contain a new, larger* sft of answers 
to kelp rectify the problem. * 

The Type^il revision group contained .six items 
that needed .examination. Each was,flound \o have a 
unique problem, not necessarily related 1o mechani- 
cal difficulties, but more to actual learning difficul-. 
ties^» Thus* each item, was examined and will be re- 
written in an attempt to dbPVe each particular prob- 
lem . • % , t 
, «■ t k 

There was pttly one item'Sn the Type III gro.up. „ 
This item Ijad'a very low success rate, C4K7%) and 
many comments. I^was determined from the com- 
ments ^Hat the user did not kn^ow wha,t he/she wa^ 
♦supposed to do. A's'aJ consequence, an i^tructVon 
for the use'r^will be included with that item so that 
the us£K*may uiMcrstaAd.the correct procedure fcjr 
answering the item . : ' *i 



*B0 



Those items in the 60% - 69.9% range were con- 
sidered to be of marginal success and thus should 
be reviewed, but not classified. There were eight - 
items falling within this groifp^nd when the* respon- 
ses were examined it was'.dis covered that ojie of two t 
errors *had occured. The first was the situation dis- 
cussed in the Type I revision. The other was typing 
errors that occured when the user attempted Jo enter 
his/her answer. Thus* to increase the success rate 
of these items, a more effective answer-processing 
technique wifl need to be developed. 
• 

Other revision included ideas and suggestions 
given by the users . These responses,; in most 
cases , dealt with the desire to have more information 
in certain areas oMDF or to modify, the manner in 
which the information was presentee). For example) 
alftumber of users desired to know more about* 
EDDOC and IDPUT1. Also, some felt a greater num- 
ber of diagrams and illustrations would have helped 

facilitate their learning .„ 

t i 

* ' Summary 

The major instructional goal of the tutorial is - 
that the user will be able to create a CAl program ■ 
us^ng IDF "with, the auihor's manual functioning as a 
reference. This goal was almost impossible to meas- 
ure during the testing 'procedure. t The measurement 
of the major goal came, in fact, after the actual test- 
ing was completed . Many oi the users that com- 
pleted the module had actual assignments in tfieir 
respective classes of creating a CAI modularising 
any l<ang*rage available. Upon completion of the 
module, a gr§at number of these users cKose IDF as ■ 
the language used for their projects . The author _^.?2> 
talked wUh many of the usVrs "after they had begun 
the programming and after they hafl completed the 
modules. He-received ppsitive reaction- fnom almost 4 
everyone about the IDF tutorial*. They said that it 
gave considerabie insight into some of the small 
problems and ideas foAuse during the programming. 
They also related th*t many aspects which they felt. ( 
would not bp remembered a'fter taking the tutorial 
were, in fact, recalled When the actual programming 
process for each began. These verbal comments to 
the author gavje an Indication that the major instruc- 
tional goal was achieved with relative success. . * 

Even thouglt the-major goal's attainmetft\was' 
considered successful, the testing-revision cycle 1 , 
will not beteminated. It is hoped :that>the revision 
in thevprevious section will add more poWer and 
#yield better results^ on those portions of the module 
needing it. Thus, all subsequent festing-revisdn 
cycles will then produce only minor 'problems to be * 
eliminated . * ' v > 
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